Nov 07 03:52:22 user nova-compute[74540]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74540) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 07 03:52:22 user nova-compute[74540]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74540) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 07 03:52:22 user nova-compute[74540]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74540) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 07 03:52:22 user nova-compute[74540]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 07 03:52:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:52:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.022s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:52:22 user nova-compute[74540]: INFO nova.virt.driver [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 07 03:52:23 user nova-compute[74540]: INFO nova.compute.provider_config [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] Acquiring lock "singleton_lock" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] Acquired lock "singleton_lock" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] Releasing lock "singleton_lock" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] Full set of CONF: {{(pid=74540) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ******************************************************************************** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] Configuration options gathered from: {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ================================================================================ {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] allow_resize_to_same_host      = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] arq_binding_timeout            = 300 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] backdoor_port                  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] backdoor_socket                = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] block_device_allocate_retries  = 300 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] block_device_allocate_retries_interval = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cert                           = self.pem {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute_monitors               = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] config_dir                     = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] config_drive_format            = iso9660 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] config_source                  = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] console_host                   = user {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] control_exchange               = nova {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cpu_allocation_ratio           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] daemon                         = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] debug                          = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] default_access_ip_network_name = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] default_availability_zone      = nova {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] default_ephemeral_format       = ext4 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] default_green_pool_size        = 1000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] default_schedule_zone          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] disk_allocation_ratio          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] enable_new_services            = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] enabled_ssl_apis               = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] flat_injected                  = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] force_config_drive             = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] force_raw_images               = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] graceful_shutdown_timeout      = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] heal_instance_info_cache_interval = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] host                           = user {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] instance_build_timeout         = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] instance_delete_interval       = 300 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] instance_name_template         = instance-%08x {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] instance_usage_audit           = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] instance_usage_audit_period    = month {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] internal_service_availability_zone = internal {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] key                            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] live_migration_retry_count     = 30 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] log_config_append              = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] log_dir                        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] log_file                       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] log_options                    = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] log_rotate_interval            = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] log_rotate_interval_type       = days {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] log_rotation_type              = none {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] long_rpc_timeout               = 1800 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] max_concurrent_builds          = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] max_concurrent_live_migrations = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] max_concurrent_snapshots       = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] max_local_block_devices        = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] max_logfile_count              = 30 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] max_logfile_size_mb            = 200 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] maximum_instance_delete_attempts = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] metadata_listen                = 0.0.0.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] metadata_listen_port           = 8775 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] metadata_workers               = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] migrate_max_retries            = -1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] mkisofs_cmd                    = genisoimage {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] my_ip                          = 10.0.0.210 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] network_allocate_retries       = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] osapi_compute_listen_port      = 8774 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] osapi_compute_unique_server_name_scope =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] osapi_compute_workers          = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] password_length                = 12 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] periodic_enable                = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] periodic_fuzzy_delay           = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] pointer_model                  = ps2mouse {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] preallocate_images             = none {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] publish_errors                 = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] pybasedir                      = /opt/stack/nova {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ram_allocation_ratio           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] rate_limit_burst               = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] rate_limit_except_level        = CRITICAL {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] rate_limit_interval            = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] reboot_timeout                 = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] reclaim_instance_interval      = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] record                         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] reimage_timeout_per_gb         = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] report_interval                = 120 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] rescue_timeout                 = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] reserved_host_cpus             = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] reserved_host_disk_mb          = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] reserved_host_memory_mb        = 512 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] reserved_huge_pages            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] resize_confirm_window          = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] resize_fs_using_block_device   = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] resume_guests_state_on_host_boot = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] rpc_response_timeout           = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] run_external_periodic_tasks    = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] running_deleted_instance_action = reap {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] running_deleted_instance_timeout = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] scheduler_instance_sync_interval = 120 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] service_down_time              = 720 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] servicegroup_driver            = db {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] shelved_offload_time           = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] shelved_poll_interval          = 3600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] shutdown_timeout               = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] source_is_ipv6                 = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ssl_only                       = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] state_path                     = /opt/stack/data/nova {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] sync_power_state_interval      = 600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] sync_power_state_pool_size     = 1000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] syslog_log_facility            = LOG_USER {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] tempdir                        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] timeout_nbd                    = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] transport_url                  = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] update_resources_interval      = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] use_cow_images                 = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] use_eventlog                   = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] use_journal                    = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] use_json                       = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] use_rootwrap_daemon            = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] use_stderr                     = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] use_syslog                     = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vcpu_pin_set                   = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plugging_is_fatal          = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plugging_timeout           = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] virt_mkfs                      = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] volume_usage_poll_interval     = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] watch_log_file                 = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] web                            = /usr/share/spice-html5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_concurrency.disable_process_locking = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.auth_strategy              = keystone {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.compute_link_prefix        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.dhcp_domain                = novalocal {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.enable_instance_password   = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.glance_link_prefix         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.instance_list_per_project_cells = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.list_records_by_skipping_down_cells = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.local_metadata_per_cell    = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.max_limit                  = 1000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.metadata_cache_expiration  = 15 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.neutron_default_tenant_id  = default {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.use_forwarded_for          = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.use_neutron_default_nets   = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.vendordata_dynamic_targets = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.vendordata_jsonfile_path   = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.backend_argument         = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.config_prefix            = cache.oslo {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.dead_timeout             = 60.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.debug_cache_backend      = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.enable_retry_client      = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.enable_socket_keepalive  = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.enabled                  = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.expiration_time          = 600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.hashclient_retry_attempts = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.memcache_dead_retry      = 300 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.memcache_password        =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.memcache_sasl_enabled    = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.memcache_username        =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.proxies                  = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.retry_attempts           = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.retry_delay              = 0.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.socket_keepalive_count   = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.socket_keepalive_idle    = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.socket_keepalive_interval = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.tls_allowed_ciphers      = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.tls_cafile               = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.tls_certfile             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.tls_enabled              = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cache.tls_keyfile              = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.auth_section            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.auth_type               = password {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.cafile                  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.certfile                = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.collect_timing          = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.cross_az_attach         = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.debug                   = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.endpoint_template       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.http_retries            = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.insecure                = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.keyfile                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.os_region_name          = RegionOne {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.split_loggers           = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cinder.timeout                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute.cpu_dedicated_set      = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute.cpu_shared_set         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute.image_type_exclude_list = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute.resource_provider_association_refresh = 300 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute.shutdown_retry_interval = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] conductor.workers              = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] console.allowed_origins        = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] console.ssl_ciphers            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] console.ssl_minimum_version    = default {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] consoleauth.token_ttl          = 600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.cafile                  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.certfile                = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.collect_timing          = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.connect_retries         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.connect_retry_delay     = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.endpoint_override       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.insecure                = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.keyfile                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.max_version             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.min_version             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.region_name             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.service_name            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.service_type            = accelerator {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.split_loggers           = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.status_code_retries     = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.status_code_retry_delay = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.timeout                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] cyborg.version                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.backend               = sqlalchemy {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.connection            = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.connection_debug      = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.connection_parameters =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.connection_recycle_time = 3600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.connection_trace      = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.db_inc_retry_interval = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.db_max_retries        = 20 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.db_max_retry_interval = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.db_retry_interval     = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.max_overflow          = 50 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.max_pool_size         = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.max_retries           = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.mysql_wsrep_sync_wait = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.pool_timeout          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.retry_interval        = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.slave_connection      = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] database.sqlite_synchronous    = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.backend           = sqlalchemy {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.connection        = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.connection_debug  = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.connection_parameters =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.connection_recycle_time = 3600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.connection_trace  = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.db_inc_retry_interval = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.db_max_retries    = 20 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.db_max_retry_interval = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.db_retry_interval = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.max_overflow      = 50 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.max_pool_size     = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.max_retries       = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.pool_timeout      = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.retry_interval    = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.slave_connection  = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] api_database.sqlite_synchronous = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] devices.enabled_mdev_types     = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ephemeral_storage_encryption.enabled = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.api_servers             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.cafile                  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.certfile                = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.collect_timing          = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.connect_retries         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.connect_retry_delay     = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.debug                   = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.default_trusted_certificate_ids = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.enable_certificate_validation = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.enable_rbd_download     = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.endpoint_override       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.insecure                = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.keyfile                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.max_version             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.min_version             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.num_retries             = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.rbd_ceph_conf           =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.rbd_connect_timeout     = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.rbd_pool                =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.rbd_user                =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.region_name             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.service_name            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.service_type            = image {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.split_loggers           = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.status_code_retries     = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.status_code_retry_delay = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.timeout                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.verify_glance_signatures = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] glance.version                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] guestfs.debug                  = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.config_drive_cdrom      = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.config_drive_inject_password = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.enable_remotefx         = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.instances_path_share    =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.limit_cpu_features      = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.use_multipath_io        = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.vswitch_name            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] mks.enabled                    = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] image_cache.manager_interval   = 2400 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] image_cache.precache_concurrency = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] image_cache.remove_unused_base_images = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] image_cache.subdirectory_name  = _base {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.api_max_retries         = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.api_retry_interval      = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.auth_section            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.auth_type               = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.cafile                  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.certfile                = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.collect_timing          = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.conductor_group         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.connect_retries         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.connect_retry_delay     = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.endpoint_override       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.insecure                = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.keyfile                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.max_version             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.min_version             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.peer_list               = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.region_name             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.serial_console_state_timeout = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.service_name            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.service_type            = baremetal {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.split_loggers           = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.status_code_retries     = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.status_code_retry_delay = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.timeout                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ironic.version                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] key_manager.fixed_key          = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.barbican_api_version  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.barbican_endpoint     = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.barbican_endpoint_type = public {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.barbican_region_name  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.cafile                = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.certfile              = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.collect_timing        = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.insecure              = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.keyfile               = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.number_of_retries     = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.retry_delay           = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.send_service_user_token = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.split_loggers         = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.timeout               = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.verify_ssl            = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican.verify_ssl_path       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican_service_user.auth_section = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican_service_user.auth_type = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican_service_user.cafile   = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican_service_user.certfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican_service_user.collect_timing = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican_service_user.insecure = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican_service_user.keyfile  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican_service_user.split_loggers = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] barbican_service_user.timeout  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.approle_role_id          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.approle_secret_id        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.cafile                   = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.certfile                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.collect_timing           = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.insecure                 = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.keyfile                  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.kv_mountpoint            = secret {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.kv_path                  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.kv_version               = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.namespace                = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.root_token_id            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.split_loggers            = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.ssl_ca_crt_file          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.timeout                  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.use_ssl                  = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.auth_section          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.auth_type             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.cafile                = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.certfile              = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.collect_timing        = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.connect_retries       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.connect_retry_delay   = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.endpoint_override     = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.insecure              = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.keyfile               = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.max_version           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.min_version           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.region_name           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.service_name          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.service_type          = identity {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.split_loggers         = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.status_code_retries   = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.status_code_retry_delay = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.timeout               = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] keystone.version               = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.connection_uri         =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.cpu_mode               = custom {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: WARNING oslo_config.cfg [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.cpu_power_governor_high = performance {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.cpu_power_management   = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.device_detach_attempts = 8 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.device_detach_timeout  = 20 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.disk_cachemodes        = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.disk_prefix            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.enabled_perf_events    = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.file_backed_memory     = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.gid_maps               = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.hw_disk_discard        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.hw_machine_type        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.images_rbd_pool        = rbd {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.images_type            = default {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.images_volume_group    = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.inject_key             = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.inject_partition       = -2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.inject_password        = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.iscsi_iface            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.iser_use_multipath     = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_downtime = 500 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_inbound_addr = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_scheme  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_timeout_action = abort {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_tunnelled = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: WARNING oslo_config.cfg [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 07 03:52:23 user nova-compute[74540]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 07 03:52:23 user nova-compute[74540]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 07 03:52:23 user nova-compute[74540]: and ``live_migration_inbound_addr`` respectively.
Nov 07 03:52:23 user nova-compute[74540]: ).  Its value may be silently ignored in the future.
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.live_migration_with_native_tls = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.max_queues             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.nfs_mount_options      = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.num_pcie_ports         = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.pmem_namespaces        = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.quobyte_client_cfg     = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.rbd_secret_uuid        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.rbd_user               = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.rescue_image_id        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.rescue_kernel_id       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.rx_queue_size          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.smbfs_mount_options    =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.snapshot_compression   = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.snapshot_image_format  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.sparse_logical_volumes = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.swtpm_enabled          = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.swtpm_group            = tss {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.swtpm_user             = tss {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.sysinfo_serial         = unique {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.tb_cache_size          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.tx_queue_size          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.uid_maps               = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.use_virtio_for_bridges = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.virt_type              = kvm {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.volume_clear           = zero {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.volume_clear_size      = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.volume_use_multipath   = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.vzstorage_cache_path   = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.auth_section           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.auth_type              = password {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.cafile                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.certfile               = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.collect_timing         = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.connect_retries        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.connect_retry_delay    = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.default_floating_pool  = public {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.endpoint_override      = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.extension_sync_interval = 600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.http_retries           = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.insecure               = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.keyfile                = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.max_version            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.min_version            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.ovs_bridge             = br-int {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.physnets               = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.region_name            = RegionOne {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.service_metadata_proxy = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.service_name           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.service_type           = network {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.split_loggers          = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.status_code_retries    = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.status_code_retry_delay = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.timeout                = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] neutron.version                = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] notifications.bdms_in_notifications = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] notifications.default_level    = INFO {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] notifications.notification_format = unversioned {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] notifications.notify_on_state_change = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] pci.alias                      = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] pci.device_spec                = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] pci.report_in_placement        = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.auth_section         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.auth_type            = password {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.cafile               = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.certfile             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.collect_timing       = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.connect_retries      = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.connect_retry_delay  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.default_domain_id    = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.default_domain_name  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.domain_id            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.domain_name          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.endpoint_override    = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.insecure             = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.keyfile              = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.max_version          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.min_version          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.password             = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.project_domain_id    = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.project_domain_name  = Default {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.project_id           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.project_name         = service {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.region_name          = RegionOne {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.service_name         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.service_type         = placement {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.split_loggers        = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.status_code_retries  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.status_code_retry_delay = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.system_scope         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.timeout              = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.trust_id             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.user_domain_id       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.user_domain_name     = Default {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.user_id              = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.username             = placement {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] placement.version              = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.cores                    = 20 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.count_usage_from_placement = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.injected_file_content_bytes = 10240 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.injected_file_path_length = 255 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.injected_files           = 5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.instances                = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.key_pairs                = 100 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.metadata_items           = 128 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.ram                      = 51200 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.recheck_quota            = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.server_group_members     = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] quota.server_groups            = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] rdp.enabled                    = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] scheduler.image_metadata_prefilter = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] scheduler.max_attempts         = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] scheduler.max_placement_results = 1000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] scheduler.workers              = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.host_subset_size = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.isolated_hosts = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.isolated_images = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.pci_in_placement = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.track_instance_changes = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] metrics.required               = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] metrics.weight_multiplier      = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] metrics.weight_setting         = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] serial_console.enabled         = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] serial_console.port_range      = 10000:20000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] serial_console.serialproxy_port = 6083 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] service_user.auth_section      = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] service_user.auth_type         = password {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] service_user.cafile            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] service_user.certfile          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] service_user.collect_timing    = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] service_user.insecure          = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] service_user.keyfile           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] service_user.send_service_user_token = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] service_user.split_loggers     = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] service_user.timeout           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] spice.agent_enabled            = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] spice.enabled                  = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] spice.html5proxy_port          = 6082 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] spice.image_compression        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] spice.jpeg_compression         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] spice.playback_compression     = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] spice.server_listen            = 127.0.0.1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] spice.streaming_mode           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] spice.zlib_compression         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] upgrade_levels.baseapi         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] upgrade_levels.cert            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] upgrade_levels.compute         = auto {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] upgrade_levels.conductor       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] upgrade_levels.scheduler       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vendordata_dynamic_auth.cafile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vendordata_dynamic_auth.certfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vendordata_dynamic_auth.insecure = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vendordata_dynamic_auth.timeout = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.api_retry_count         = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.ca_file                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.cache_prefix            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.cluster_name            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.connection_pool_size    = 10 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.console_delay_seconds   = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.datastore_regex         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.host_ip                 = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.host_password           = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.host_port               = 443 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.host_username           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.insecure                = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.integration_bridge      = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.maximum_objects         = 100 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.pbm_default_policy      = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.pbm_enabled             = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.pbm_wsdl_location       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.serial_port_proxy_uri   = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.serial_port_service_uri = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.task_poll_interval      = 0.5 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.use_linked_clone        = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.vnc_keymap              = en-us {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.vnc_port                = 5900 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vmware.vnc_port_total          = 10000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vnc.auth_schemes               = ['none'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vnc.enabled                    = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vnc.novncproxy_port            = 6080 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vnc.vencrypt_ca_certs          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vnc.vencrypt_client_cert       = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vnc.vencrypt_client_key        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.disable_rootwrap   = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.enable_numa_live_migration = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.libvirt_disable_apic = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] wsgi.client_socket_timeout     = 900 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] wsgi.default_pool_size         = 1000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] wsgi.keep_alive                = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] wsgi.max_header_line           = 16384 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] wsgi.ssl_ca_file               = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] wsgi.ssl_cert_file             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] wsgi.ssl_key_file              = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] wsgi.tcp_keepidle              = 600 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] zvm.ca_file                    = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] zvm.cloud_connector_url        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] zvm.reachable_timeout          = 300 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_policy.enforce_new_defaults = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_policy.enforce_scope      = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_policy.policy_default_rule = default {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler.connection_string     = messaging:// {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler.enabled               = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler.es_doc_type           = notification {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler.es_scroll_size        = 10000 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler.es_scroll_time        = 2m {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler.filter_error_trace    = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler.hmac_keys             = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler.sentinel_service_name = mymaster {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler.socket_timeout        = 0.1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler.trace_requests        = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler.trace_sqlalchemy      = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler_jaeger.process_tags   = {} {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler_jaeger.service_name_prefix = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] profiler_otlp.service_name_prefix = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] remote_debug.host              = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] remote_debug.port              = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_notifications.retry = -1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.auth_section        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.auth_type           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.cafile              = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.certfile            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.collect_timing      = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.connect_retries     = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.connect_retry_delay = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.endpoint_id         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.endpoint_override   = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.insecure            = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.keyfile             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.max_version         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.min_version         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.region_name         = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.service_name        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.service_type        = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.split_loggers       = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.status_code_retries = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.status_code_retry_delay = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.timeout             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.valid_interfaces    = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_limit.version             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_reports.file_event_handler = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] oslo_reports.log_dir           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plug_ovs_privileged.group  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] vif_plug_ovs_privileged.user   = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_ovs.isolate_vif         = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] os_brick.lock_path             = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] privsep_osbrick.capabilities   = [21] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] privsep_osbrick.group          = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] privsep_osbrick.helper_command = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] privsep_osbrick.user           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] nova_sys_admin.group           = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] nova_sys_admin.helper_command  = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] nova_sys_admin.user            = None {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG oslo_service.service [None req-2a18f058-5f16-4935-8837-05a4c3e7ecf5 None None] ******************************************************************************** {{(pid=74540) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 07 03:52:23 user nova-compute[74540]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 07 03:52:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Connecting to libvirt: qemu:///system {{(pid=74540) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fee1d523040> {{(pid=74540) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 07 03:52:23 user nova-compute[74540]: libvirt:  error : internal error: could not initialize domain event timer
Nov 07 03:52:23 user nova-compute[74540]: WARNING nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 07 03:52:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fee1d523040> {{(pid=74540) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Starting native event thread {{(pid=74540) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Starting green dispatch thread {{(pid=74540) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 07 03:52:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Starting connection event dispatch thread {{(pid=74540) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 07 03:52:23 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Connection event '1' reason 'None'
Nov 07 03:52:23 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 07 03:52:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.mount [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Initialising _HostMountState generation 0 {{(pid=74540) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 07 03:52:30 user nova-compute[74540]: INFO nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Libvirt host capabilities <capabilities>
Nov 07 03:52:30 user nova-compute[74540]:   <host>
Nov 07 03:52:30 user nova-compute[74540]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 07 03:52:30 user nova-compute[74540]:     <cpu>
Nov 07 03:52:30 user nova-compute[74540]:       <arch>x86_64</arch>
Nov 07 03:52:30 user nova-compute[74540]:       <model>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <vendor>Intel</vendor>
Nov 07 03:52:30 user nova-compute[74540]:       <microcode version='1070'/>
Nov 07 03:52:30 user nova-compute[74540]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 07 03:52:30 user nova-compute[74540]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='ss'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='vmx'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='pcid'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='osxsave'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='hypervisor'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='arat'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='tsc_adjust'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='md-clear'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='arch-capabilities'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='invtsc'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='rsba'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature name='skip-l1dfl-vmentry'/>
Nov 07 03:52:30 user nova-compute[74540]:       <pages unit='KiB' size='4'/>
Nov 07 03:52:30 user nova-compute[74540]:       <pages unit='KiB' size='2048'/>
Nov 07 03:52:30 user nova-compute[74540]:     </cpu>
Nov 07 03:52:30 user nova-compute[74540]:     <power_management>
Nov 07 03:52:30 user nova-compute[74540]:       <suspend_mem/>
Nov 07 03:52:30 user nova-compute[74540]:       <suspend_disk/>
Nov 07 03:52:30 user nova-compute[74540]:       <suspend_hybrid/>
Nov 07 03:52:30 user nova-compute[74540]:     </power_management>
Nov 07 03:52:30 user nova-compute[74540]:     <iommu support='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     <migration_features>
Nov 07 03:52:30 user nova-compute[74540]:       <live/>
Nov 07 03:52:30 user nova-compute[74540]:       <uri_transports>
Nov 07 03:52:30 user nova-compute[74540]:         <uri_transport>tcp</uri_transport>
Nov 07 03:52:30 user nova-compute[74540]:         <uri_transport>rdma</uri_transport>
Nov 07 03:52:30 user nova-compute[74540]:       </uri_transports>
Nov 07 03:52:30 user nova-compute[74540]:     </migration_features>
Nov 07 03:52:30 user nova-compute[74540]:     <topology>
Nov 07 03:52:30 user nova-compute[74540]:       <cells num='2'>
Nov 07 03:52:30 user nova-compute[74540]:         <cell id='0'>
Nov 07 03:52:30 user nova-compute[74540]:           <memory unit='KiB'>8140616</memory>
Nov 07 03:52:30 user nova-compute[74540]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 07 03:52:30 user nova-compute[74540]:           <pages unit='KiB' size='2048'>0</pages>
Nov 07 03:52:30 user nova-compute[74540]:           <distances>
Nov 07 03:52:30 user nova-compute[74540]:             <sibling id='0' value='10'/>
Nov 07 03:52:30 user nova-compute[74540]:             <sibling id='1' value='20'/>
Nov 07 03:52:30 user nova-compute[74540]:           </distances>
Nov 07 03:52:30 user nova-compute[74540]:           <cpus num='6'>
Nov 07 03:52:30 user nova-compute[74540]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 07 03:52:30 user nova-compute[74540]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 07 03:52:30 user nova-compute[74540]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 07 03:52:30 user nova-compute[74540]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 07 03:52:30 user nova-compute[74540]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 07 03:52:30 user nova-compute[74540]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 07 03:52:30 user nova-compute[74540]:           </cpus>
Nov 07 03:52:30 user nova-compute[74540]:         </cell>
Nov 07 03:52:30 user nova-compute[74540]:         <cell id='1'>
Nov 07 03:52:30 user nova-compute[74540]:           <memory unit='KiB'>8255068</memory>
Nov 07 03:52:30 user nova-compute[74540]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 07 03:52:30 user nova-compute[74540]:           <pages unit='KiB' size='2048'>0</pages>
Nov 07 03:52:30 user nova-compute[74540]:           <distances>
Nov 07 03:52:30 user nova-compute[74540]:             <sibling id='0' value='20'/>
Nov 07 03:52:30 user nova-compute[74540]:             <sibling id='1' value='10'/>
Nov 07 03:52:30 user nova-compute[74540]:           </distances>
Nov 07 03:52:30 user nova-compute[74540]:           <cpus num='6'>
Nov 07 03:52:30 user nova-compute[74540]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 07 03:52:30 user nova-compute[74540]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 07 03:52:30 user nova-compute[74540]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 07 03:52:30 user nova-compute[74540]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 07 03:52:30 user nova-compute[74540]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 07 03:52:30 user nova-compute[74540]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 07 03:52:30 user nova-compute[74540]:           </cpus>
Nov 07 03:52:30 user nova-compute[74540]:         </cell>
Nov 07 03:52:30 user nova-compute[74540]:       </cells>
Nov 07 03:52:30 user nova-compute[74540]:     </topology>
Nov 07 03:52:30 user nova-compute[74540]:     <cache>
Nov 07 03:52:30 user nova-compute[74540]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 07 03:52:30 user nova-compute[74540]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 07 03:52:30 user nova-compute[74540]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 07 03:52:30 user nova-compute[74540]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 07 03:52:30 user nova-compute[74540]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 07 03:52:30 user nova-compute[74540]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 07 03:52:30 user nova-compute[74540]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 07 03:52:30 user nova-compute[74540]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 07 03:52:30 user nova-compute[74540]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 07 03:52:30 user nova-compute[74540]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 07 03:52:30 user nova-compute[74540]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 07 03:52:30 user nova-compute[74540]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 07 03:52:30 user nova-compute[74540]:     </cache>
Nov 07 03:52:30 user nova-compute[74540]:     <secmodel>
Nov 07 03:52:30 user nova-compute[74540]:       <model>apparmor</model>
Nov 07 03:52:30 user nova-compute[74540]:       <doi>0</doi>
Nov 07 03:52:30 user nova-compute[74540]:     </secmodel>
Nov 07 03:52:30 user nova-compute[74540]:     <secmodel>
Nov 07 03:52:30 user nova-compute[74540]:       <model>dac</model>
Nov 07 03:52:30 user nova-compute[74540]:       <doi>0</doi>
Nov 07 03:52:30 user nova-compute[74540]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 07 03:52:30 user nova-compute[74540]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 07 03:52:30 user nova-compute[74540]:     </secmodel>
Nov 07 03:52:30 user nova-compute[74540]:   </host>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='alpha'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>64</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>clipper</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='armv6l'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>integratorcp</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>borzoi</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>spitz</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>nuri</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>musca-b1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>versatileab</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>kzm</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>musca-a</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>smdkc210</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sx1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>z2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>tosa</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>sabrelite</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>realview-eb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>n810</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>n800</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>versatilepb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>terrier</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mainstone</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>midway</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>musicpal</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>microbit</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>cubieboard</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>verdex</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>netduino2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>raspi2b</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>cheetah</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>highbank</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>akita</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>connex</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>collie</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>raspi0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='armv7l'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>integratorcp</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>borzoi</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>spitz</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>nuri</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>musca-b1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>versatileab</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>kzm</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>musca-a</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>smdkc210</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sx1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>z2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>tosa</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>sabrelite</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>realview-eb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>n810</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>n800</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>versatilepb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>terrier</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mainstone</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>midway</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>musicpal</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>microbit</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>cubieboard</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>verdex</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>netduino2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>raspi2b</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>cheetah</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>highbank</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>akita</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>connex</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>collie</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>raspi0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='aarch64'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>64</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>integratorcp</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>borzoi</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>spitz</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>nuri</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>musca-b1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>versatileab</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>kzm</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>musca-a</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>smdkc210</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sx1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>z2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>tosa</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>sabrelite</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>realview-eb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>n810</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>n800</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>versatilepb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>terrier</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mainstone</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>midway</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>musicpal</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>microbit</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>cubieboard</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>verdex</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>netduino2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>raspi3b</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>raspi2b</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>cheetah</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>highbank</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>akita</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>connex</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>collie</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>raspi0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <acpi default='on' toggle='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='cris'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='i686'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>x-remote</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>isapc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>microvm</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='kvm'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <pae/>
Nov 07 03:52:30 user nova-compute[74540]:       <nonpae/>
Nov 07 03:52:30 user nova-compute[74540]:       <acpi default='on' toggle='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:       <apic default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='m68k'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>an5206</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>q800</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>next-cube</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='microblaze'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='microblazeel'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='mips'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='16'>malta</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mipssim</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='mipsel'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='16'>malta</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mipssim</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='mips64'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>64</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='16'>malta</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mipssim</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>pica61</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>magnum</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='mips64el'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>64</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='16'>malta</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mipssim</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>pica61</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>magnum</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='16'>boston</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='ppc'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>g3beige</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mac99</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>ppce500</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>pegasos2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sam460ex</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>bamboo</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>40p</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>ref405ep</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>taihu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='ppc64'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>64</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2048'>powernv9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>taihu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2048'>powernv10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>ppce500</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>40p</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>pegasos2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>bamboo</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>g3beige</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mac99</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sam460ex</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>ref405ep</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2048'>powernv8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='ppc64le'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>64</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2048'>powernv9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>taihu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2048'>powernv10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>ppce500</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>40p</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>pegasos2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>bamboo</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>g3beige</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>mac99</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sam460ex</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>ref405ep</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2048'>powernv8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='riscv32'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='8'>spike</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>opentitan</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='5'>sifive_u</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sifive_e</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='8'>virt</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='riscv64'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>64</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='8'>spike</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='5'>sifive_u</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>shakti_c</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sifive_e</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='8'>virt</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='s390x'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>64</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='sh4'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>shix</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>r2d</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='sh4eb'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>64</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>shix</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>r2d</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='sparc'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>SS-5</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>SS-20</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>LX</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>SS-4</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>SS-10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>Voyager</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='sparc64'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>64</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sun4u</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>niagara</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>sun4v</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='x86_64'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>64</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>x-remote</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='1'>isapc</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>microvm</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='kvm'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <acpi default='on' toggle='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:       <apic default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='xtensa'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>sim</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>kc705</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>ml605</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>virt</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>lx200</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>lx60</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]:   <guest>
Nov 07 03:52:30 user nova-compute[74540]:     <os_type>hvm</os_type>
Nov 07 03:52:30 user nova-compute[74540]:     <arch name='xtensaeb'>
Nov 07 03:52:30 user nova-compute[74540]:       <wordsize>32</wordsize>
Nov 07 03:52:30 user nova-compute[74540]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='4'>sim</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>kc705</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>ml605</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>virt</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>lx200</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>lx60</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 07 03:52:30 user nova-compute[74540]:       <domain type='qemu'/>
Nov 07 03:52:30 user nova-compute[74540]:     </arch>
Nov 07 03:52:30 user nova-compute[74540]:     <features>
Nov 07 03:52:30 user nova-compute[74540]:       <cpuselection/>
Nov 07 03:52:30 user nova-compute[74540]:       <deviceboot/>
Nov 07 03:52:30 user nova-compute[74540]:       <disksnapshot default='on' toggle='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     </features>
Nov 07 03:52:30 user nova-compute[74540]:   </guest>
Nov 07 03:52:30 user nova-compute[74540]: </capabilities>
Nov 07 03:52:30 user nova-compute[74540]: 
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 07 03:52:30 user nova-compute[74540]: <domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:   <path>/usr/bin/qemu-system-i386</path>
Nov 07 03:52:30 user nova-compute[74540]:   <domain>kvm</domain>
Nov 07 03:52:30 user nova-compute[74540]:   <machine>pc-q35-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:   <arch>i686</arch>
Nov 07 03:52:30 user nova-compute[74540]:   <vcpu max='288'/>
Nov 07 03:52:30 user nova-compute[74540]:   <iothreads supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:   <os supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='firmware'/>
Nov 07 03:52:30 user nova-compute[74540]:     <loader supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>rom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pflash</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='readonly'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>yes</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='secure'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </loader>
Nov 07 03:52:30 user nova-compute[74540]:   </os>
Nov 07 03:52:30 user nova-compute[74540]:   <cpu>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-passthrough' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='hostPassthroughMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='maximum' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='maximumMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>on</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-model' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <vendor>Intel</vendor>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ss'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='vmx'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='pcid'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='hypervisor'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arat'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='umip'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='md-clear'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibpb'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibrs'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='erms'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='lm'/>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='custom' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>qemu64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>qemu32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>phenom</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>n270</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>kvm64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>kvm32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>coreduo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>core2duo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>athlon</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Westmere-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Westmere</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Snowridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Penryn</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G5</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G4</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G1</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Nehalem-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Nehalem</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Rome</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Milan</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Dhyana</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cooperlake</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Conroe</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>486</model>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:   </cpu>
Nov 07 03:52:30 user nova-compute[74540]:   <memoryBacking supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='sourceType'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>file</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>anonymous</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>memfd</value>
Nov 07 03:52:30 user nova-compute[74540]:     </enum>
Nov 07 03:52:30 user nova-compute[74540]:   </memoryBacking>
Nov 07 03:52:30 user nova-compute[74540]:   <devices>
Nov 07 03:52:30 user nova-compute[74540]:     <disk supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='diskDevice'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>disk</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cdrom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>floppy</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>lun</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='bus'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>fdc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sata</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </disk>
Nov 07 03:52:30 user nova-compute[74540]:     <graphics supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sdl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vnc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>spice</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egl-headless</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </graphics>
Nov 07 03:52:30 user nova-compute[74540]:     <video supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='modelType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cirrus</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vmvga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>qxl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>none</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>bochs</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>ramfb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </video>
Nov 07 03:52:30 user nova-compute[74540]:     <hostdev supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='mode'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>subsystem</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='startupPolicy'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>default</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>mandatory</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>requisite</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>optional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='subsysType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pci</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='capsType'/>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='pciBackend'/>
Nov 07 03:52:30 user nova-compute[74540]:     </hostdev>
Nov 07 03:52:30 user nova-compute[74540]:     <rng supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>random</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egd</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>builtin</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </rng>
Nov 07 03:52:30 user nova-compute[74540]:     <filesystem supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='driverType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>path</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>handle</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtiofs</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </filesystem>
Nov 07 03:52:30 user nova-compute[74540]:     <tpm supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-tis</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-crb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>passthrough</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>emulator</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </tpm>
Nov 07 03:52:30 user nova-compute[74540]:   </devices>
Nov 07 03:52:30 user nova-compute[74540]:   <features>
Nov 07 03:52:30 user nova-compute[74540]:     <gic supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     <vmcoreinfo supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <genid supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backingStoreInput supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backup supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <sev supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:   </features>
Nov 07 03:52:30 user nova-compute[74540]: </domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:  {{(pid=74540) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 07 03:52:30 user nova-compute[74540]: <domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:   <path>/usr/bin/qemu-system-i386</path>
Nov 07 03:52:30 user nova-compute[74540]:   <domain>kvm</domain>
Nov 07 03:52:30 user nova-compute[74540]:   <machine>pc-q35-jammy</machine>
Nov 07 03:52:30 user nova-compute[74540]:   <arch>i686</arch>
Nov 07 03:52:30 user nova-compute[74540]:   <vcpu max='288'/>
Nov 07 03:52:30 user nova-compute[74540]:   <iothreads supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:   <os supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='firmware'/>
Nov 07 03:52:30 user nova-compute[74540]:     <loader supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>rom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pflash</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='readonly'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>yes</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='secure'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </loader>
Nov 07 03:52:30 user nova-compute[74540]:   </os>
Nov 07 03:52:30 user nova-compute[74540]:   <cpu>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-passthrough' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='hostPassthroughMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='maximum' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='maximumMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>on</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-model' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <vendor>Intel</vendor>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ss'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='vmx'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='pcid'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='hypervisor'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arat'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='umip'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='md-clear'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibpb'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibrs'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='erms'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='lm'/>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='custom' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>qemu64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>qemu32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>phenom</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>n270</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>kvm64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>kvm32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>coreduo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>core2duo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>athlon</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Westmere-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Westmere</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Snowridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Penryn</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G5</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G4</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G1</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Nehalem-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Nehalem</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Rome</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Milan</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Dhyana</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cooperlake</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Conroe</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>486</model>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:   </cpu>
Nov 07 03:52:30 user nova-compute[74540]:   <memoryBacking supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='sourceType'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>file</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>anonymous</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>memfd</value>
Nov 07 03:52:30 user nova-compute[74540]:     </enum>
Nov 07 03:52:30 user nova-compute[74540]:   </memoryBacking>
Nov 07 03:52:30 user nova-compute[74540]:   <devices>
Nov 07 03:52:30 user nova-compute[74540]:     <disk supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='diskDevice'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>disk</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cdrom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>floppy</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>lun</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='bus'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>fdc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sata</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </disk>
Nov 07 03:52:30 user nova-compute[74540]:     <graphics supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sdl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vnc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>spice</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egl-headless</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </graphics>
Nov 07 03:52:30 user nova-compute[74540]:     <video supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='modelType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cirrus</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vmvga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>qxl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>none</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>bochs</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>ramfb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </video>
Nov 07 03:52:30 user nova-compute[74540]:     <hostdev supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='mode'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>subsystem</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='startupPolicy'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>default</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>mandatory</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>requisite</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>optional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='subsysType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pci</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='capsType'/>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='pciBackend'/>
Nov 07 03:52:30 user nova-compute[74540]:     </hostdev>
Nov 07 03:52:30 user nova-compute[74540]:     <rng supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>random</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egd</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>builtin</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </rng>
Nov 07 03:52:30 user nova-compute[74540]:     <filesystem supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='driverType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>path</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>handle</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtiofs</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </filesystem>
Nov 07 03:52:30 user nova-compute[74540]:     <tpm supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-tis</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-crb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>passthrough</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>emulator</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </tpm>
Nov 07 03:52:30 user nova-compute[74540]:   </devices>
Nov 07 03:52:30 user nova-compute[74540]:   <features>
Nov 07 03:52:30 user nova-compute[74540]:     <gic supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     <vmcoreinfo supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <genid supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backingStoreInput supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backup supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <sev supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:   </features>
Nov 07 03:52:30 user nova-compute[74540]: </domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:  {{(pid=74540) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 07 03:52:30 user nova-compute[74540]: <domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:   <path>/usr/bin/qemu-system-i386</path>
Nov 07 03:52:30 user nova-compute[74540]:   <domain>kvm</domain>
Nov 07 03:52:30 user nova-compute[74540]:   <machine>pc-i440fx-jammy</machine>
Nov 07 03:52:30 user nova-compute[74540]:   <arch>i686</arch>
Nov 07 03:52:30 user nova-compute[74540]:   <vcpu max='255'/>
Nov 07 03:52:30 user nova-compute[74540]:   <iothreads supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:   <os supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='firmware'/>
Nov 07 03:52:30 user nova-compute[74540]:     <loader supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>rom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pflash</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='readonly'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>yes</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='secure'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </loader>
Nov 07 03:52:30 user nova-compute[74540]:   </os>
Nov 07 03:52:30 user nova-compute[74540]:   <cpu>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-passthrough' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='hostPassthroughMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='maximum' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='maximumMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>on</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-model' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <vendor>Intel</vendor>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ss'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='vmx'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='pcid'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='hypervisor'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arat'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='umip'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='md-clear'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibpb'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibrs'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='erms'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='lm'/>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='custom' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>qemu64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>qemu32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>phenom</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>n270</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>kvm64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>kvm32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>coreduo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>core2duo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>athlon</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Westmere-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Westmere</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Snowridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Penryn</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G5</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G4</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G1</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Nehalem-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Nehalem</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Rome</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Milan</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Dhyana</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cooperlake</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Conroe</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>486</model>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:   </cpu>
Nov 07 03:52:30 user nova-compute[74540]:   <memoryBacking supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='sourceType'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>file</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>anonymous</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>memfd</value>
Nov 07 03:52:30 user nova-compute[74540]:     </enum>
Nov 07 03:52:30 user nova-compute[74540]:   </memoryBacking>
Nov 07 03:52:30 user nova-compute[74540]:   <devices>
Nov 07 03:52:30 user nova-compute[74540]:     <disk supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='diskDevice'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>disk</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cdrom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>floppy</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>lun</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='bus'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>ide</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>fdc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sata</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </disk>
Nov 07 03:52:30 user nova-compute[74540]:     <graphics supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sdl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vnc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>spice</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egl-headless</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </graphics>
Nov 07 03:52:30 user nova-compute[74540]:     <video supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='modelType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cirrus</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vmvga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>qxl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>none</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>bochs</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>ramfb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </video>
Nov 07 03:52:30 user nova-compute[74540]:     <hostdev supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='mode'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>subsystem</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='startupPolicy'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>default</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>mandatory</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>requisite</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>optional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='subsysType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pci</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='capsType'/>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='pciBackend'/>
Nov 07 03:52:30 user nova-compute[74540]:     </hostdev>
Nov 07 03:52:30 user nova-compute[74540]:     <rng supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>random</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egd</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>builtin</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </rng>
Nov 07 03:52:30 user nova-compute[74540]:     <filesystem supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='driverType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>path</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>handle</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtiofs</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </filesystem>
Nov 07 03:52:30 user nova-compute[74540]:     <tpm supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-tis</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-crb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>passthrough</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>emulator</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </tpm>
Nov 07 03:52:30 user nova-compute[74540]:   </devices>
Nov 07 03:52:30 user nova-compute[74540]:   <features>
Nov 07 03:52:30 user nova-compute[74540]:     <gic supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     <vmcoreinfo supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <genid supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backingStoreInput supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backup supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <sev supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:   </features>
Nov 07 03:52:30 user nova-compute[74540]: </domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:  {{(pid=74540) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 07 03:52:30 user nova-compute[74540]: <domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:   <path>/usr/bin/qemu-system-i386</path>
Nov 07 03:52:30 user nova-compute[74540]:   <domain>kvm</domain>
Nov 07 03:52:30 user nova-compute[74540]:   <machine>pc-i440fx-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:   <arch>i686</arch>
Nov 07 03:52:30 user nova-compute[74540]:   <vcpu max='255'/>
Nov 07 03:52:30 user nova-compute[74540]:   <iothreads supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:   <os supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='firmware'/>
Nov 07 03:52:30 user nova-compute[74540]:     <loader supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>rom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pflash</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='readonly'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>yes</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='secure'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </loader>
Nov 07 03:52:30 user nova-compute[74540]:   </os>
Nov 07 03:52:30 user nova-compute[74540]:   <cpu>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-passthrough' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='hostPassthroughMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='maximum' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='maximumMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>on</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-model' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <vendor>Intel</vendor>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ss'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='vmx'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='pcid'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='hypervisor'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arat'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='umip'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='md-clear'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibpb'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibrs'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='erms'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='lm'/>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='custom' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>qemu64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>qemu32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>phenom</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>n270</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>kvm64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>kvm32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>coreduo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>core2duo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>athlon</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Westmere-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Westmere</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Snowridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Penryn</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G5</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G4</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G1</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Nehalem-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Nehalem</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Rome</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Milan</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Dhyana</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cooperlake</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Conroe</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>486</model>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:   </cpu>
Nov 07 03:52:30 user nova-compute[74540]:   <memoryBacking supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='sourceType'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>file</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>anonymous</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>memfd</value>
Nov 07 03:52:30 user nova-compute[74540]:     </enum>
Nov 07 03:52:30 user nova-compute[74540]:   </memoryBacking>
Nov 07 03:52:30 user nova-compute[74540]:   <devices>
Nov 07 03:52:30 user nova-compute[74540]:     <disk supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='diskDevice'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>disk</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cdrom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>floppy</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>lun</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='bus'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>ide</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>fdc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sata</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </disk>
Nov 07 03:52:30 user nova-compute[74540]:     <graphics supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sdl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vnc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>spice</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egl-headless</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </graphics>
Nov 07 03:52:30 user nova-compute[74540]:     <video supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='modelType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cirrus</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vmvga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>qxl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>none</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>bochs</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>ramfb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </video>
Nov 07 03:52:30 user nova-compute[74540]:     <hostdev supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='mode'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>subsystem</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='startupPolicy'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>default</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>mandatory</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>requisite</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>optional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='subsysType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pci</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='capsType'/>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='pciBackend'/>
Nov 07 03:52:30 user nova-compute[74540]:     </hostdev>
Nov 07 03:52:30 user nova-compute[74540]:     <rng supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>random</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egd</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>builtin</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </rng>
Nov 07 03:52:30 user nova-compute[74540]:     <filesystem supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='driverType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>path</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>handle</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtiofs</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </filesystem>
Nov 07 03:52:30 user nova-compute[74540]:     <tpm supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-tis</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-crb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>passthrough</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>emulator</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </tpm>
Nov 07 03:52:30 user nova-compute[74540]:   </devices>
Nov 07 03:52:30 user nova-compute[74540]:   <features>
Nov 07 03:52:30 user nova-compute[74540]:     <gic supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     <vmcoreinfo supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <genid supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backingStoreInput supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backup supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <sev supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:   </features>
Nov 07 03:52:30 user nova-compute[74540]: </domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:  {{(pid=74540) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 07 03:52:30 user nova-compute[74540]: <domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 07 03:52:30 user nova-compute[74540]:   <domain>kvm</domain>
Nov 07 03:52:30 user nova-compute[74540]:   <machine>pc-q35-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:   <arch>x86_64</arch>
Nov 07 03:52:30 user nova-compute[74540]:   <vcpu max='288'/>
Nov 07 03:52:30 user nova-compute[74540]:   <iothreads supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:   <os supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='firmware'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>efi</value>
Nov 07 03:52:30 user nova-compute[74540]:     </enum>
Nov 07 03:52:30 user nova-compute[74540]:     <loader supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>rom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pflash</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='readonly'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>yes</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='secure'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>yes</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </loader>
Nov 07 03:52:30 user nova-compute[74540]:   </os>
Nov 07 03:52:30 user nova-compute[74540]:   <cpu>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-passthrough' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='hostPassthroughMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>on</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='maximum' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='maximumMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>on</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-model' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <vendor>Intel</vendor>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ss'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='vmx'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='pcid'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='hypervisor'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arat'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='umip'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='md-clear'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='invtsc'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibpb'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibrs'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='rsba'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='pschange-mc-no'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='erms'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='custom' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>qemu64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>qemu32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>phenom</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>n270</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>kvm64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>kvm32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>coreduo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>core2duo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>athlon</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Westmere-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Westmere</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Snowridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Penryn</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G5</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G4</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Opteron_G1</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Nehalem</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Rome</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Milan</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Dhyana</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cooperlake</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Conroe</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>486</model>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:   </cpu>
Nov 07 03:52:30 user nova-compute[74540]:   <memoryBacking supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='sourceType'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>file</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>anonymous</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>memfd</value>
Nov 07 03:52:30 user nova-compute[74540]:     </enum>
Nov 07 03:52:30 user nova-compute[74540]:   </memoryBacking>
Nov 07 03:52:30 user nova-compute[74540]:   <devices>
Nov 07 03:52:30 user nova-compute[74540]:     <disk supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='diskDevice'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>disk</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cdrom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>floppy</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>lun</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='bus'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>fdc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sata</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </disk>
Nov 07 03:52:30 user nova-compute[74540]:     <graphics supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sdl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vnc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>spice</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egl-headless</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </graphics>
Nov 07 03:52:30 user nova-compute[74540]:     <video supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='modelType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cirrus</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vmvga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>qxl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>none</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>bochs</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>ramfb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </video>
Nov 07 03:52:30 user nova-compute[74540]:     <hostdev supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='mode'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>subsystem</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='startupPolicy'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>default</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>mandatory</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>requisite</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>optional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='subsysType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pci</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='capsType'/>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='pciBackend'/>
Nov 07 03:52:30 user nova-compute[74540]:     </hostdev>
Nov 07 03:52:30 user nova-compute[74540]:     <rng supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>random</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egd</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>builtin</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </rng>
Nov 07 03:52:30 user nova-compute[74540]:     <filesystem supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='driverType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>path</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>handle</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtiofs</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </filesystem>
Nov 07 03:52:30 user nova-compute[74540]:     <tpm supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-tis</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-crb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>passthrough</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>emulator</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </tpm>
Nov 07 03:52:30 user nova-compute[74540]:   </devices>
Nov 07 03:52:30 user nova-compute[74540]:   <features>
Nov 07 03:52:30 user nova-compute[74540]:     <gic supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     <vmcoreinfo supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <genid supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backingStoreInput supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backup supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <sev supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:   </features>
Nov 07 03:52:30 user nova-compute[74540]: </domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:  {{(pid=74540) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 07 03:52:30 user nova-compute[74540]: <domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 07 03:52:30 user nova-compute[74540]:   <domain>kvm</domain>
Nov 07 03:52:30 user nova-compute[74540]:   <machine>pc-q35-jammy</machine>
Nov 07 03:52:30 user nova-compute[74540]:   <arch>x86_64</arch>
Nov 07 03:52:30 user nova-compute[74540]:   <vcpu max='288'/>
Nov 07 03:52:30 user nova-compute[74540]:   <iothreads supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:   <os supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='firmware'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>efi</value>
Nov 07 03:52:30 user nova-compute[74540]:     </enum>
Nov 07 03:52:30 user nova-compute[74540]:     <loader supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>rom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pflash</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='readonly'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>yes</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='secure'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>yes</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </loader>
Nov 07 03:52:30 user nova-compute[74540]:   </os>
Nov 07 03:52:30 user nova-compute[74540]:   <cpu>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-passthrough' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='hostPassthroughMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>on</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='maximum' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='maximumMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>on</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-model' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <vendor>Intel</vendor>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ss'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='vmx'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='pcid'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='hypervisor'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arat'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='umip'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='md-clear'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='invtsc'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibpb'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibrs'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='rsba'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='pschange-mc-no'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='erms'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='custom' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>qemu64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>qemu32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>phenom</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>n270</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>kvm64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>kvm32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>coreduo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>core2duo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>athlon</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Westmere-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Westmere</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Snowridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Penryn</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G5</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G4</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Opteron_G1</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Nehalem</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Rome</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Milan</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Dhyana</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cooperlake</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Conroe</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>486</model>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:   </cpu>
Nov 07 03:52:30 user nova-compute[74540]:   <memoryBacking supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='sourceType'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>file</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>anonymous</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>memfd</value>
Nov 07 03:52:30 user nova-compute[74540]:     </enum>
Nov 07 03:52:30 user nova-compute[74540]:   </memoryBacking>
Nov 07 03:52:30 user nova-compute[74540]:   <devices>
Nov 07 03:52:30 user nova-compute[74540]:     <disk supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='diskDevice'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>disk</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cdrom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>floppy</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>lun</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='bus'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>fdc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sata</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </disk>
Nov 07 03:52:30 user nova-compute[74540]:     <graphics supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sdl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vnc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>spice</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egl-headless</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </graphics>
Nov 07 03:52:30 user nova-compute[74540]:     <video supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='modelType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cirrus</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vmvga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>qxl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>none</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>bochs</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>ramfb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </video>
Nov 07 03:52:30 user nova-compute[74540]:     <hostdev supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='mode'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>subsystem</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='startupPolicy'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>default</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>mandatory</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>requisite</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>optional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='subsysType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pci</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='capsType'/>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='pciBackend'/>
Nov 07 03:52:30 user nova-compute[74540]:     </hostdev>
Nov 07 03:52:30 user nova-compute[74540]:     <rng supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>random</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egd</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>builtin</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </rng>
Nov 07 03:52:30 user nova-compute[74540]:     <filesystem supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='driverType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>path</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>handle</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtiofs</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </filesystem>
Nov 07 03:52:30 user nova-compute[74540]:     <tpm supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-tis</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-crb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>passthrough</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>emulator</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </tpm>
Nov 07 03:52:30 user nova-compute[74540]:   </devices>
Nov 07 03:52:30 user nova-compute[74540]:   <features>
Nov 07 03:52:30 user nova-compute[74540]:     <gic supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     <vmcoreinfo supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <genid supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backingStoreInput supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backup supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <sev supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:   </features>
Nov 07 03:52:30 user nova-compute[74540]: </domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:  {{(pid=74540) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 07 03:52:30 user nova-compute[74540]: <domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 07 03:52:30 user nova-compute[74540]:   <domain>kvm</domain>
Nov 07 03:52:30 user nova-compute[74540]:   <machine>pc-i440fx-jammy</machine>
Nov 07 03:52:30 user nova-compute[74540]:   <arch>x86_64</arch>
Nov 07 03:52:30 user nova-compute[74540]:   <vcpu max='255'/>
Nov 07 03:52:30 user nova-compute[74540]:   <iothreads supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:   <os supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='firmware'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>efi</value>
Nov 07 03:52:30 user nova-compute[74540]:     </enum>
Nov 07 03:52:30 user nova-compute[74540]:     <loader supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>rom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pflash</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='readonly'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>yes</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='secure'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </loader>
Nov 07 03:52:30 user nova-compute[74540]:   </os>
Nov 07 03:52:30 user nova-compute[74540]:   <cpu>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-passthrough' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='hostPassthroughMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>on</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='maximum' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='maximumMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>on</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-model' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <vendor>Intel</vendor>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ss'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='vmx'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='pcid'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='hypervisor'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arat'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='umip'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='md-clear'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='invtsc'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibpb'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibrs'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='rsba'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='pschange-mc-no'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='erms'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='custom' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>qemu64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>qemu32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>phenom</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>n270</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>kvm64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>kvm32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>coreduo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>core2duo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>athlon</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Westmere-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Westmere</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Snowridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Penryn</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G5</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G4</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Opteron_G1</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Nehalem</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Rome</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Milan</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Dhyana</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cooperlake</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Conroe</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>486</model>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:   </cpu>
Nov 07 03:52:30 user nova-compute[74540]:   <memoryBacking supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='sourceType'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>file</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>anonymous</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>memfd</value>
Nov 07 03:52:30 user nova-compute[74540]:     </enum>
Nov 07 03:52:30 user nova-compute[74540]:   </memoryBacking>
Nov 07 03:52:30 user nova-compute[74540]:   <devices>
Nov 07 03:52:30 user nova-compute[74540]:     <disk supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='diskDevice'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>disk</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cdrom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>floppy</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>lun</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='bus'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>ide</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>fdc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sata</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </disk>
Nov 07 03:52:30 user nova-compute[74540]:     <graphics supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sdl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vnc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>spice</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egl-headless</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </graphics>
Nov 07 03:52:30 user nova-compute[74540]:     <video supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='modelType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cirrus</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vmvga</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>qxl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>none</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>bochs</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>ramfb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </video>
Nov 07 03:52:30 user nova-compute[74540]:     <hostdev supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='mode'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>subsystem</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='startupPolicy'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>default</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>mandatory</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>requisite</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>optional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='subsysType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pci</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='capsType'/>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='pciBackend'/>
Nov 07 03:52:30 user nova-compute[74540]:     </hostdev>
Nov 07 03:52:30 user nova-compute[74540]:     <rng supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>random</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egd</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>builtin</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </rng>
Nov 07 03:52:30 user nova-compute[74540]:     <filesystem supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='driverType'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>path</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>handle</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtiofs</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </filesystem>
Nov 07 03:52:30 user nova-compute[74540]:     <tpm supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-tis</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>tpm-crb</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>passthrough</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>emulator</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </tpm>
Nov 07 03:52:30 user nova-compute[74540]:   </devices>
Nov 07 03:52:30 user nova-compute[74540]:   <features>
Nov 07 03:52:30 user nova-compute[74540]:     <gic supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:     <vmcoreinfo supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <genid supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backingStoreInput supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <backup supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:     <sev supported='no'/>
Nov 07 03:52:30 user nova-compute[74540]:   </features>
Nov 07 03:52:30 user nova-compute[74540]: </domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:  {{(pid=74540) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 03:52:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 07 03:52:30 user nova-compute[74540]: <domainCapabilities>
Nov 07 03:52:30 user nova-compute[74540]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 07 03:52:30 user nova-compute[74540]:   <domain>kvm</domain>
Nov 07 03:52:30 user nova-compute[74540]:   <machine>pc-i440fx-6.2</machine>
Nov 07 03:52:30 user nova-compute[74540]:   <arch>x86_64</arch>
Nov 07 03:52:30 user nova-compute[74540]:   <vcpu max='255'/>
Nov 07 03:52:30 user nova-compute[74540]:   <iothreads supported='yes'/>
Nov 07 03:52:30 user nova-compute[74540]:   <os supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='firmware'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>efi</value>
Nov 07 03:52:30 user nova-compute[74540]:     </enum>
Nov 07 03:52:30 user nova-compute[74540]:     <loader supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>rom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>pflash</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='readonly'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>yes</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='secure'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>no</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </loader>
Nov 07 03:52:30 user nova-compute[74540]:   </os>
Nov 07 03:52:30 user nova-compute[74540]:   <cpu>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-passthrough' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='hostPassthroughMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>on</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='maximum' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='maximumMigratable'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>on</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>off</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='host-model' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <vendor>Intel</vendor>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ss'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='vmx'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='pcid'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='hypervisor'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arat'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='tsc_adjust'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='umip'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='md-clear'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='arch-capabilities'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='invtsc'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibpb'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='ibrs'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-stibp'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='amd-ssbd'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='rsba'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='require' name='pschange-mc-no'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='erms'/>
Nov 07 03:52:30 user nova-compute[74540]:       <feature policy='disable' name='xsaveopt'/>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:     <mode name='custom' supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>qemu64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>qemu32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>phenom</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>pentium</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>n270</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>kvm64</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>kvm32</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>coreduo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>core2duo</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>athlon</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Westmere-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Westmere</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Snowridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Skylake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>SandyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Penryn</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G5</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G4</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G3</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Opteron_G2</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Opteron_G1</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Nehalem</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>IvyBridge</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Icelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Haswell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Rome</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-Milan</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC-IBPB</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>EPYC</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Dhyana</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cooperlake</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>Conroe</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Cascadelake-Server</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-noTSX</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell-IBRS</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='no'>Broadwell</model>
Nov 07 03:52:30 user nova-compute[74540]:       <model usable='yes'>486</model>
Nov 07 03:52:30 user nova-compute[74540]:     </mode>
Nov 07 03:52:30 user nova-compute[74540]:   </cpu>
Nov 07 03:52:30 user nova-compute[74540]:   <memoryBacking supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:     <enum name='sourceType'>
Nov 07 03:52:30 user nova-compute[74540]:       <value>file</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>anonymous</value>
Nov 07 03:52:30 user nova-compute[74540]:       <value>memfd</value>
Nov 07 03:52:30 user nova-compute[74540]:     </enum>
Nov 07 03:52:30 user nova-compute[74540]:   </memoryBacking>
Nov 07 03:52:30 user nova-compute[74540]:   <devices>
Nov 07 03:52:30 user nova-compute[74540]:     <disk supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='diskDevice'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>disk</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>cdrom</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>floppy</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>lun</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='bus'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>ide</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>fdc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sata</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:30 user nova-compute[74540]:       </enum>
Nov 07 03:52:30 user nova-compute[74540]:     </disk>
Nov 07 03:52:30 user nova-compute[74540]:     <graphics supported='yes'>
Nov 07 03:52:30 user nova-compute[74540]:       <enum name='type'>
Nov 07 03:52:30 user nova-compute[74540]:         <value>sdl</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>vnc</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>spice</value>
Nov 07 03:52:30 user nova-compute[74540]:         <value>egl-headless</value>
Nov 07 03:52:31 user nova-compute[74540]:       </enum>
Nov 07 03:52:31 user nova-compute[74540]:     </graphics>
Nov 07 03:52:31 user nova-compute[74540]:     <video supported='yes'>
Nov 07 03:52:31 user nova-compute[74540]:       <enum name='modelType'>
Nov 07 03:52:31 user nova-compute[74540]:         <value>vga</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>cirrus</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>vmvga</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>qxl</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>none</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>bochs</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>ramfb</value>
Nov 07 03:52:31 user nova-compute[74540]:       </enum>
Nov 07 03:52:31 user nova-compute[74540]:     </video>
Nov 07 03:52:31 user nova-compute[74540]:     <hostdev supported='yes'>
Nov 07 03:52:31 user nova-compute[74540]:       <enum name='mode'>
Nov 07 03:52:31 user nova-compute[74540]:         <value>subsystem</value>
Nov 07 03:52:31 user nova-compute[74540]:       </enum>
Nov 07 03:52:31 user nova-compute[74540]:       <enum name='startupPolicy'>
Nov 07 03:52:31 user nova-compute[74540]:         <value>default</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>mandatory</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>requisite</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>optional</value>
Nov 07 03:52:31 user nova-compute[74540]:       </enum>
Nov 07 03:52:31 user nova-compute[74540]:       <enum name='subsysType'>
Nov 07 03:52:31 user nova-compute[74540]:         <value>usb</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>pci</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>scsi</value>
Nov 07 03:52:31 user nova-compute[74540]:       </enum>
Nov 07 03:52:31 user nova-compute[74540]:       <enum name='capsType'/>
Nov 07 03:52:31 user nova-compute[74540]:       <enum name='pciBackend'/>
Nov 07 03:52:31 user nova-compute[74540]:     </hostdev>
Nov 07 03:52:31 user nova-compute[74540]:     <rng supported='yes'>
Nov 07 03:52:31 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:31 user nova-compute[74540]:         <value>virtio</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>virtio-transitional</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>virtio-non-transitional</value>
Nov 07 03:52:31 user nova-compute[74540]:       </enum>
Nov 07 03:52:31 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:31 user nova-compute[74540]:         <value>random</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>egd</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>builtin</value>
Nov 07 03:52:31 user nova-compute[74540]:       </enum>
Nov 07 03:52:31 user nova-compute[74540]:     </rng>
Nov 07 03:52:31 user nova-compute[74540]:     <filesystem supported='yes'>
Nov 07 03:52:31 user nova-compute[74540]:       <enum name='driverType'>
Nov 07 03:52:31 user nova-compute[74540]:         <value>path</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>handle</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>virtiofs</value>
Nov 07 03:52:31 user nova-compute[74540]:       </enum>
Nov 07 03:52:31 user nova-compute[74540]:     </filesystem>
Nov 07 03:52:31 user nova-compute[74540]:     <tpm supported='yes'>
Nov 07 03:52:31 user nova-compute[74540]:       <enum name='model'>
Nov 07 03:52:31 user nova-compute[74540]:         <value>tpm-tis</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>tpm-crb</value>
Nov 07 03:52:31 user nova-compute[74540]:       </enum>
Nov 07 03:52:31 user nova-compute[74540]:       <enum name='backendModel'>
Nov 07 03:52:31 user nova-compute[74540]:         <value>passthrough</value>
Nov 07 03:52:31 user nova-compute[74540]:         <value>emulator</value>
Nov 07 03:52:31 user nova-compute[74540]:       </enum>
Nov 07 03:52:31 user nova-compute[74540]:     </tpm>
Nov 07 03:52:31 user nova-compute[74540]:   </devices>
Nov 07 03:52:31 user nova-compute[74540]:   <features>
Nov 07 03:52:31 user nova-compute[74540]:     <gic supported='no'/>
Nov 07 03:52:31 user nova-compute[74540]:     <vmcoreinfo supported='yes'/>
Nov 07 03:52:31 user nova-compute[74540]:     <genid supported='yes'/>
Nov 07 03:52:31 user nova-compute[74540]:     <backingStoreInput supported='yes'/>
Nov 07 03:52:31 user nova-compute[74540]:     <backup supported='yes'/>
Nov 07 03:52:31 user nova-compute[74540]:     <sev supported='no'/>
Nov 07 03:52:31 user nova-compute[74540]:   </features>
Nov 07 03:52:31 user nova-compute[74540]: </domainCapabilities>
Nov 07 03:52:31 user nova-compute[74540]:  {{(pid=74540) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74540) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74540) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Checking secure boot support for host arch (x86_64) {{(pid=74540) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 07 03:52:31 user nova-compute[74540]: INFO nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Secure Boot support detected
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] cpu compare xml: <cpu match="exact">
Nov 07 03:52:31 user nova-compute[74540]:   <model>Nehalem</model>
Nov 07 03:52:31 user nova-compute[74540]: </cpu>
Nov 07 03:52:31 user nova-compute[74540]:  {{(pid=74540) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 07 03:52:31 user nova-compute[74540]: INFO nova.virt.node [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Generated node identity 6fab23dc-967a-41e4-85df-347deed7f4ba
Nov 07 03:52:31 user nova-compute[74540]: INFO nova.virt.node [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Wrote node identity 6fab23dc-967a-41e4-85df-347deed7f4ba to /opt/stack/data/nova/compute_id
Nov 07 03:52:31 user nova-compute[74540]: WARNING nova.compute.manager [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Compute nodes ['6fab23dc-967a-41e4-85df-347deed7f4ba'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 07 03:52:31 user nova-compute[74540]: INFO nova.compute.manager [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 07 03:52:31 user nova-compute[74540]: WARNING nova.compute.manager [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 07 03:52:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 03:52:31 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:52:31 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Hypervisor/Node resource view: name=user free_ram=10926MB free_disk=25.974586486816406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:52:31 user nova-compute[74540]: WARNING nova.compute.resource_tracker [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] No compute node record for user:6fab23dc-967a-41e4-85df-347deed7f4ba: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6fab23dc-967a-41e4-85df-347deed7f4ba could not be found.
Nov 07 03:52:31 user nova-compute[74540]: INFO nova.compute.resource_tracker [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Compute node record created for user:user with uuid: 6fab23dc-967a-41e4-85df-347deed7f4ba
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 03:52:31 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] [req-d58801af-efd8-494f-9731-ac13f2e92bcc] Created resource provider record via placement API for resource provider with UUID 6fab23dc-967a-41e4-85df-347deed7f4ba and name user.
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74540) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 07 03:52:31 user nova-compute[74540]: INFO nova.virt.libvirt.host [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] kernel doesn't support AMD SEV
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Libvirt baseline CPU <cpu>
Nov 07 03:52:31 user nova-compute[74540]:   <arch>x86_64</arch>
Nov 07 03:52:31 user nova-compute[74540]:   <model>Nehalem</model>
Nov 07 03:52:31 user nova-compute[74540]:   <vendor>Intel</vendor>
Nov 07 03:52:31 user nova-compute[74540]:   <topology sockets="6" cores="1" threads="1"/>
Nov 07 03:52:31 user nova-compute[74540]: </cpu>
Nov 07 03:52:31 user nova-compute[74540]:  {{(pid=74540) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Updated inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Updating resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba generation from 0 to 1 during operation: update_inventory {{(pid=74540) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Updating resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba generation from 1 to 2 during operation: update_traits {{(pid=74540) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.608s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:52:31 user nova-compute[74540]: DEBUG nova.service [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Creating RPC server for service compute {{(pid=74540) start /opt/stack/nova/nova/service.py:182}}
Nov 07 03:52:32 user nova-compute[74540]: DEBUG nova.service [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] Join ServiceGroup membership for this service compute {{(pid=74540) start /opt/stack/nova/nova/service.py:199}}
Nov 07 03:52:32 user nova-compute[74540]: DEBUG nova.servicegroup.drivers.db [None req-630a071d-f1f1-4621-b5ce-19ea6b89729d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74540) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 07 03:52:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:52:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:53:22 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 03:53:23 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:53:23 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:53:23 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=10357MB free_disk=25.878414154052734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 03:53:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:53:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:53:23 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 03:53:23 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 03:53:23 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:53:23 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:53:23 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 03:53:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:54:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:54:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:54:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:54:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 03:54:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:54:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:54:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 03:54:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 03:54:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 03:54:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:54:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:54:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:54:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:54:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:54:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:54:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:54:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:54:24 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 03:54:25 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:54:25 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:54:25 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=10287MB free_disk=25.914188385009766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 03:54:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:54:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:54:25 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 03:54:25 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 03:54:25 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:54:25 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:54:25 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 03:54:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:55:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:55:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:55:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:55:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 03:55:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 03:55:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 03:55:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:55:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:55:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:55:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:55:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 03:55:25 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:55:26 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:55:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:55:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:55:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:55:26 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 03:55:27 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:55:27 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:55:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=10271MB free_disk=25.69501495361328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 03:55:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:55:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:55:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 03:55:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 03:55:27 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:55:27 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:55:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 03:55:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:56:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:56:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:56:25 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:56:25 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:56:25 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:56:26 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:56:26 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 03:56:26 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 03:56:26 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 03:56:26 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:56:26 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:56:26 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 03:56:26 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:56:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:26 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 03:56:27 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:27 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=9515MB free_disk=25.674434661865234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 03:56:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 03:56:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 03:56:27 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:56:27 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:56:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 03:56:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:56:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:56:32 user nova-compute[74540]: INFO nova.compute.claims [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Claim successful on node user
Nov 07 03:56:32 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:56:32 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:56:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:56:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:56:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:56:32 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 03:56:33 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:56:33 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Creating image(s)
Nov 07 03:56:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "/opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "/opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "/opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c.part --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG nova.policy [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3b660fa816a404196af3027d19aea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a9f3df6bba4675b2332ac4ded5373e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG nova.virt.images [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] b2fc4ee2-830c-4852-b2e5-8dcdd33e1718 was qcow2, converting to raw {{(pid=74540) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c.part /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c.converted {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c.part /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c.converted" returned: 0 in 0.200s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c.converted --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.880s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:34 user nova-compute[74540]: INFO oslo.privsep.daemon [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmf85v0x3/privsep.sock']
Nov 07 03:56:34 user sudo[84112]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmf85v0x3/privsep.sock
Nov 07 03:56:34 user sudo[84112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 07 03:56:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG nova.compute.manager [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:56:34 user nova-compute[74540]: INFO nova.compute.claims [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Claim successful on node user
Nov 07 03:56:34 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG nova.compute.manager [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG nova.compute.manager [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG nova.network.neutron [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:56:34 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 03:56:34 user nova-compute[74540]: DEBUG nova.compute.manager [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG nova.compute.manager [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:56:34 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Creating image(s)
Nov 07 03:56:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "/opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "/opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "/opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:35 user nova-compute[74540]: DEBUG nova.policy [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3b660fa816a404196af3027d19aea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a9f3df6bba4675b2332ac4ded5373e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:56:35 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Successfully created port: 22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:56:35 user sudo[84112]: pam_unix(sudo:session): session closed for user root
Nov 07 03:56:35 user nova-compute[74540]: INFO oslo.privsep.daemon [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Spawned new privsep daemon via rootwrap
Nov 07 03:56:35 user nova-compute[74540]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 07 03:56:35 user nova-compute[74540]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 07 03:56:35 user nova-compute[74540]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 07 03:56:35 user nova-compute[74540]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84120
Nov 07 03:56:35 user nova-compute[74540]: WARNING oslo_privsep.priv_context [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] privsep daemon already running
Nov 07 03:56:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.195s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:56:36 user nova-compute[74540]: INFO nova.compute.claims [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Claim successful on node user
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk 1073741824" returned: 0 in 0.043s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.254s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.198s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk 1073741824" returned: 0 in 0.051s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:56:36 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Cannot resize image /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Ensure instance console log exists: /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 03:56:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG nova.policy [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1aae6f239de4d6994efd7eace1ceecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20cf66849de49ce9591749b8a941d76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:56:37 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Creating image(s)
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "/opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "/opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG nova.network.neutron [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Successfully created port: ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Cannot resize image /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Ensure instance console log exists: /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk 1073741824" returned: 0 in 0.052s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.197s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Cannot resize image /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Ensure instance console log exists: /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:56:38 user nova-compute[74540]: INFO nova.compute.claims [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Claim successful on node user
Nov 07 03:56:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "d6501f90-9180-4e99-a294-9ffba799c247" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "d6501f90-9180-4e99-a294-9ffba799c247" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.compute.manager [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.032s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:56:38 user nova-compute[74540]: INFO nova.compute.claims [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Claim successful on node user
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:56:38 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Successfully updated port: 22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:56:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:56:38 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Creating image(s)
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "/opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "/opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquired lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.169s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.compute.manager [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-4d03f653-6f4f-474b-8dd0-d59403b9d439 req-f172bb1a-bfc5-4fa3-a067-02f8bcc1d8fa service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-changed-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-4d03f653-6f4f-474b-8dd0-d59403b9d439 req-f172bb1a-bfc5-4fa3-a067-02f8bcc1d8fa service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Refreshing instance network info cache due to event network-changed-22b86445-e99f-4e4c-a265-bd37533ae9cf. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4d03f653-6f4f-474b-8dd0-d59403b9d439 req-f172bb1a-bfc5-4fa3-a067-02f8bcc1d8fa service nova] Acquiring lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.187s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.policy [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0218f41629a9468f80011fb04e917600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede989d4b3d34f1b996f135913039586', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.compute.manager [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.network.neutron [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk 1073741824" returned: 0 in 0.055s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:39 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.compute.manager [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.compute.manager [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:56:39 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Creating image(s)
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "/opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "/opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.policy [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3079ba3a84ea4b4bb4a3e576ab4133ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620cefdadcec49d6a696aa7db8cef2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Successfully created port: b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Cannot resize image /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Ensure instance console log exists: /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.network.neutron [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Successfully updated port: ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquired lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:56:39 user nova-compute[74540]: DEBUG nova.network.neutron [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk 1073741824" returned: 0 in 0.046s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.network.neutron [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-a2cdc89b-43fa-49fd-9b66-2b695dc7a963 req-5f20bd65-599c-45fc-85fb-dbfaac437ebd service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received event network-changed-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-a2cdc89b-43fa-49fd-9b66-2b695dc7a963 req-5f20bd65-599c-45fc-85fb-dbfaac437ebd service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Refreshing instance network info cache due to event network-changed-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a2cdc89b-43fa-49fd-9b66-2b695dc7a963 req-5f20bd65-599c-45fc-85fb-dbfaac437ebd service nova] Acquiring lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.167s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updating instance_info_cache with network_info: [{"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Releasing lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Instance network_info: |[{"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4d03f653-6f4f-474b-8dd0-d59403b9d439 req-f172bb1a-bfc5-4fa3-a067-02f8bcc1d8fa service nova] Acquired lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.network.neutron [req-4d03f653-6f4f-474b-8dd0-d59403b9d439 req-f172bb1a-bfc5-4fa3-a067-02f8bcc1d8fa service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Refreshing network info cache for port 22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Start _get_guest_xml network_info=[{"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:56:40 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:40 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Cannot resize image /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Ensure instance console log exists: /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-345609166',display_name='tempest-ServerRescueNegativeTestJSON-server-345609166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-345609166',id=1,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60a9f3df6bba4675b2332ac4ded5373e',ramdisk_id='',reservation_id='r-rw6qcnv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1326022799',owner_user_name='tempest-ServerRescueNegativeTestJSON-1326022799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:33Z,user_data=None,user_id='c3b660fa816a404196af3027d19aea51',uuid=22ebfad2-30ec-4f1a-8575-d655d36c6f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converting VIF {"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:7b:81,bridge_name='br-int',has_traffic_filtering=True,id=22b86445-e99f-4e4c-a265-bd37533ae9cf,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b86445-e9') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'pci_devices' on Instance uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:56:40 user nova-compute[74540]:   <uuid>22ebfad2-30ec-4f1a-8575-d655d36c6f91</uuid>
Nov 07 03:56:40 user nova-compute[74540]:   <name>instance-00000001</name>
Nov 07 03:56:40 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:56:40 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:56:40 user nova-compute[74540]:   <metadata>
Nov 07 03:56:40 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:56:40 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:56:40 user nova-compute[74540]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-345609166</nova:name>
Nov 07 03:56:40 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:56:40</nova:creationTime>
Nov 07 03:56:40 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:56:40 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:56:40 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:56:40 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:56:40 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:56:40 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:56:40 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:56:40 user nova-compute[74540]:       <nova:owner>
Nov 07 03:56:40 user nova-compute[74540]:         <nova:user uuid="c3b660fa816a404196af3027d19aea51">tempest-ServerRescueNegativeTestJSON-1326022799-project-member</nova:user>
Nov 07 03:56:40 user nova-compute[74540]:         <nova:project uuid="60a9f3df6bba4675b2332ac4ded5373e">tempest-ServerRescueNegativeTestJSON-1326022799</nova:project>
Nov 07 03:56:40 user nova-compute[74540]:       </nova:owner>
Nov 07 03:56:40 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 03:56:40 user nova-compute[74540]:       <nova:ports>
Nov 07 03:56:40 user nova-compute[74540]:         <nova:port uuid="22b86445-e99f-4e4c-a265-bd37533ae9cf">
Nov 07 03:56:40 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 03:56:40 user nova-compute[74540]:         </nova:port>
Nov 07 03:56:40 user nova-compute[74540]:       </nova:ports>
Nov 07 03:56:40 user nova-compute[74540]:     </nova:instance>
Nov 07 03:56:40 user nova-compute[74540]:   </metadata>
Nov 07 03:56:40 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:56:40 user nova-compute[74540]:     <system>
Nov 07 03:56:40 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:56:40 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:56:40 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:56:40 user nova-compute[74540]:       <entry name="serial">22ebfad2-30ec-4f1a-8575-d655d36c6f91</entry>
Nov 07 03:56:40 user nova-compute[74540]:       <entry name="uuid">22ebfad2-30ec-4f1a-8575-d655d36c6f91</entry>
Nov 07 03:56:40 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:56:40 user nova-compute[74540]:     </system>
Nov 07 03:56:40 user nova-compute[74540]:   </sysinfo>
Nov 07 03:56:40 user nova-compute[74540]:   <os>
Nov 07 03:56:40 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:56:40 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 03:56:40 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:56:40 user nova-compute[74540]:   </os>
Nov 07 03:56:40 user nova-compute[74540]:   <features>
Nov 07 03:56:40 user nova-compute[74540]:     <acpi/>
Nov 07 03:56:40 user nova-compute[74540]:     <apic/>
Nov 07 03:56:40 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:56:40 user nova-compute[74540]:   </features>
Nov 07 03:56:40 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:56:40 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:56:40 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:56:40 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:56:40 user nova-compute[74540]:   </clock>
Nov 07 03:56:40 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:56:40 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:56:40 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:56:40 user nova-compute[74540]:   </cpu>
Nov 07 03:56:40 user nova-compute[74540]:   <devices>
Nov 07 03:56:40 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 03:56:40 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 03:56:40 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk"/>
Nov 07 03:56:40 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 03:56:40 user nova-compute[74540]:     </disk>
Nov 07 03:56:40 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:56:40 user nova-compute[74540]:       <mac address="fa:16:3e:75:7b:81"/>
Nov 07 03:56:40 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:56:40 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:56:40 user nova-compute[74540]:       <target dev="tap22b86445-e9"/>
Nov 07 03:56:40 user nova-compute[74540]:     </interface>
Nov 07 03:56:40 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:56:40 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/console.log" append="off"/>
Nov 07 03:56:40 user nova-compute[74540]:     </serial>
Nov 07 03:56:40 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:56:40 user nova-compute[74540]:     <video>
Nov 07 03:56:40 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:56:40 user nova-compute[74540]:     </video>
Nov 07 03:56:40 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:56:40 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:56:40 user nova-compute[74540]:     </rng>
Nov 07 03:56:40 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:56:40 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:56:40 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:56:40 user nova-compute[74540]:     </memballoon>
Nov 07 03:56:40 user nova-compute[74540]:   </devices>
Nov 07 03:56:40 user nova-compute[74540]: </domain>
Nov 07 03:56:40 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-345609166',display_name='tempest-ServerRescueNegativeTestJSON-server-345609166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-345609166',id=1,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60a9f3df6bba4675b2332ac4ded5373e',ramdisk_id='',reservation_id='r-rw6qcnv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1326022799',owner_user_name='tempest-ServerRescueNegativeTestJSON-1326022799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:33Z,user_data=None,user_id='c3b660fa816a404196af3027d19aea51',uuid=22ebfad2-30ec-4f1a-8575-d655d36c6f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converting VIF {"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:7b:81,bridge_name='br-int',has_traffic_filtering=True,id=22b86445-e99f-4e4c-a265-bd37533ae9cf,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b86445-e9') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG os_vif [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:7b:81,bridge_name='br-int',has_traffic_filtering=True,id=22b86445-e99f-4e4c-a265-bd37533ae9cf,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b86445-e9') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Created schema index Interface.name {{(pid=74540) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Created schema index Port.name {{(pid=74540) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Created schema index Bridge.name {{(pid=74540) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [POLLOUT] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cf8380c-8eee-5c93-8726-b8780a013ab3', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:56:40 user nova-compute[74540]: INFO oslo.privsep.daemon [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmptqnpt68u/privsep.sock']
Nov 07 03:56:40 user sudo[84207]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmptqnpt68u/privsep.sock
Nov 07 03:56:40 user sudo[84207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 07 03:56:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.network.neutron [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Updating instance_info_cache with network_info: [{"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Releasing lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Instance network_info: |[{"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a2cdc89b-43fa-49fd-9b66-2b695dc7a963 req-5f20bd65-599c-45fc-85fb-dbfaac437ebd service nova] Acquired lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-a2cdc89b-43fa-49fd-9b66-2b695dc7a963 req-5f20bd65-599c-45fc-85fb-dbfaac437ebd service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Refreshing network info cache for port ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Start _get_guest_xml network_info=[{"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:56:41 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:41 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1630826878',display_name='tempest-ServerRescueNegativeTestJSON-server-1630826878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1630826878',id=2,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60a9f3df6bba4675b2332ac4ded5373e',ramdisk_id='',reservation_id='r-dh60fwvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1326022799',owner_user_name='tempest-ServerRescueNegativeTestJSON-1326022799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:35Z,user_data=None,user_id='c3b660fa816a404196af3027d19aea51',uuid=f146d8c3-a189-49da-84d0-b49dc77e4144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converting VIF {"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b1:e2,bridge_name='br-int',has_traffic_filtering=True,id=ec7cc688-a3a0-46a3-aa63-6e32ca5bf216,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7cc688-a3') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.objects.instance [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'pci_devices' on Instance uuid f146d8c3-a189-49da-84d0-b49dc77e4144 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:56:41 user nova-compute[74540]:   <uuid>f146d8c3-a189-49da-84d0-b49dc77e4144</uuid>
Nov 07 03:56:41 user nova-compute[74540]:   <name>instance-00000002</name>
Nov 07 03:56:41 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:56:41 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:56:41 user nova-compute[74540]:   <metadata>
Nov 07 03:56:41 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:56:41 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:56:41 user nova-compute[74540]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1630826878</nova:name>
Nov 07 03:56:41 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:56:41</nova:creationTime>
Nov 07 03:56:41 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:56:41 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:56:41 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:56:41 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:56:41 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:56:41 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:56:41 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:56:41 user nova-compute[74540]:       <nova:owner>
Nov 07 03:56:41 user nova-compute[74540]:         <nova:user uuid="c3b660fa816a404196af3027d19aea51">tempest-ServerRescueNegativeTestJSON-1326022799-project-member</nova:user>
Nov 07 03:56:41 user nova-compute[74540]:         <nova:project uuid="60a9f3df6bba4675b2332ac4ded5373e">tempest-ServerRescueNegativeTestJSON-1326022799</nova:project>
Nov 07 03:56:41 user nova-compute[74540]:       </nova:owner>
Nov 07 03:56:41 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 03:56:41 user nova-compute[74540]:       <nova:ports>
Nov 07 03:56:41 user nova-compute[74540]:         <nova:port uuid="ec7cc688-a3a0-46a3-aa63-6e32ca5bf216">
Nov 07 03:56:41 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 03:56:41 user nova-compute[74540]:         </nova:port>
Nov 07 03:56:41 user nova-compute[74540]:       </nova:ports>
Nov 07 03:56:41 user nova-compute[74540]:     </nova:instance>
Nov 07 03:56:41 user nova-compute[74540]:   </metadata>
Nov 07 03:56:41 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:56:41 user nova-compute[74540]:     <system>
Nov 07 03:56:41 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:56:41 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:56:41 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:56:41 user nova-compute[74540]:       <entry name="serial">f146d8c3-a189-49da-84d0-b49dc77e4144</entry>
Nov 07 03:56:41 user nova-compute[74540]:       <entry name="uuid">f146d8c3-a189-49da-84d0-b49dc77e4144</entry>
Nov 07 03:56:41 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:56:41 user nova-compute[74540]:     </system>
Nov 07 03:56:41 user nova-compute[74540]:   </sysinfo>
Nov 07 03:56:41 user nova-compute[74540]:   <os>
Nov 07 03:56:41 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:56:41 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 03:56:41 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:56:41 user nova-compute[74540]:   </os>
Nov 07 03:56:41 user nova-compute[74540]:   <features>
Nov 07 03:56:41 user nova-compute[74540]:     <acpi/>
Nov 07 03:56:41 user nova-compute[74540]:     <apic/>
Nov 07 03:56:41 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:56:41 user nova-compute[74540]:   </features>
Nov 07 03:56:41 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:56:41 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:56:41 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:56:41 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:56:41 user nova-compute[74540]:   </clock>
Nov 07 03:56:41 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:56:41 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:56:41 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:56:41 user nova-compute[74540]:   </cpu>
Nov 07 03:56:41 user nova-compute[74540]:   <devices>
Nov 07 03:56:41 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 03:56:41 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 03:56:41 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk"/>
Nov 07 03:56:41 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 03:56:41 user nova-compute[74540]:     </disk>
Nov 07 03:56:41 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:56:41 user nova-compute[74540]:       <mac address="fa:16:3e:9b:b1:e2"/>
Nov 07 03:56:41 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:56:41 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:56:41 user nova-compute[74540]:       <target dev="tapec7cc688-a3"/>
Nov 07 03:56:41 user nova-compute[74540]:     </interface>
Nov 07 03:56:41 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:56:41 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/console.log" append="off"/>
Nov 07 03:56:41 user nova-compute[74540]:     </serial>
Nov 07 03:56:41 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:56:41 user nova-compute[74540]:     <video>
Nov 07 03:56:41 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:56:41 user nova-compute[74540]:     </video>
Nov 07 03:56:41 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:56:41 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:56:41 user nova-compute[74540]:     </rng>
Nov 07 03:56:41 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:56:41 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:56:41 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:56:41 user nova-compute[74540]:     </memballoon>
Nov 07 03:56:41 user nova-compute[74540]:   </devices>
Nov 07 03:56:41 user nova-compute[74540]: </domain>
Nov 07 03:56:41 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1630826878',display_name='tempest-ServerRescueNegativeTestJSON-server-1630826878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1630826878',id=2,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60a9f3df6bba4675b2332ac4ded5373e',ramdisk_id='',reservation_id='r-dh60fwvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1326022799',owner_user_name='tempest-ServerRescueNegativeTestJSON-1326022799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:35Z,user_data=None,user_id='c3b660fa816a404196af3027d19aea51',uuid=f146d8c3-a189-49da-84d0-b49dc77e4144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converting VIF {"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b1:e2,bridge_name='br-int',has_traffic_filtering=True,id=ec7cc688-a3a0-46a3-aa63-6e32ca5bf216,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7cc688-a3') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG os_vif [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b1:e2,bridge_name='br-int',has_traffic_filtering=True,id=ec7cc688-a3a0-46a3-aa63-6e32ca5bf216,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7cc688-a3') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0f15556-1410-5f8e-af4f-9cab5bcda6a3', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Successfully created port: 27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-4d03f653-6f4f-474b-8dd0-d59403b9d439 req-f172bb1a-bfc5-4fa3-a067-02f8bcc1d8fa service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updated VIF entry in instance network info cache for port 22b86445-e99f-4e4c-a265-bd37533ae9cf. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-4d03f653-6f4f-474b-8dd0-d59403b9d439 req-f172bb1a-bfc5-4fa3-a067-02f8bcc1d8fa service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updating instance_info_cache with network_info: [{"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:56:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4d03f653-6f4f-474b-8dd0-d59403b9d439 req-f172bb1a-bfc5-4fa3-a067-02f8bcc1d8fa service nova] Releasing lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:56:42 user sudo[84207]: pam_unix(sudo:session): session closed for user root
Nov 07 03:56:42 user nova-compute[74540]: INFO oslo.privsep.daemon [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Spawned new privsep daemon via rootwrap
Nov 07 03:56:42 user nova-compute[74540]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 07 03:56:42 user nova-compute[74540]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 07 03:56:42 user nova-compute[74540]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 07 03:56:42 user nova-compute[74540]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84210
Nov 07 03:56:42 user nova-compute[74540]: WARNING oslo_privsep.priv_context [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] privsep daemon already running
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec7cc688-a3, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec7cc688-a3, col_values=(('qos', UUID('385d5628-3a62-483c-877f-cb38be372502')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec7cc688-a3, col_values=(('external_ids', {'iface-id': 'ec7cc688-a3a0-46a3-aa63-6e32ca5bf216', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:b1:e2', 'vm-uuid': 'f146d8c3-a189-49da-84d0-b49dc77e4144'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:42 user nova-compute[74540]: INFO os_vif [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:b1:e2,bridge_name='br-int',has_traffic_filtering=True,id=ec7cc688-a3a0-46a3-aa63-6e32ca5bf216,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7cc688-a3')
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22b86445-e9, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22b86445-e9, col_values=(('qos', UUID('39edd2d7-7d41-49d4-b7be-e95a4c821305')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22b86445-e9, col_values=(('external_ids', {'iface-id': '22b86445-e99f-4e4c-a265-bd37533ae9cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:7b:81', 'vm-uuid': '22ebfad2-30ec-4f1a-8575-d655d36c6f91'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:42 user nova-compute[74540]: INFO os_vif [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:7b:81,bridge_name='br-int',has_traffic_filtering=True,id=22b86445-e99f-4e4c-a265-bd37533ae9cf,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b86445-e9')
Nov 07 03:56:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No VIF found with MAC fa:16:3e:9b:b1:e2, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:56:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No VIF found with MAC fa:16:3e:75:7b:81, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:56:43 user nova-compute[74540]: DEBUG nova.network.neutron [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Successfully created port: ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:56:43 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Successfully updated port: b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:56:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:56:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquired lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:56:43 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:56:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-c6d0ca09-398f-40ef-b2c6-a39c3ba0d082 req-ed09ebba-e2dc-4c2e-8a38-d1ada5dc26a8 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-changed-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:56:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-c6d0ca09-398f-40ef-b2c6-a39c3ba0d082 req-ed09ebba-e2dc-4c2e-8a38-d1ada5dc26a8 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Refreshing instance network info cache due to event network-changed-b624973a-ace1-47d7-8733-2a76e946eaec. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:56:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c6d0ca09-398f-40ef-b2c6-a39c3ba0d082 req-ed09ebba-e2dc-4c2e-8a38-d1ada5dc26a8 service nova] Acquiring lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:56:43 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:56:43 user nova-compute[74540]: DEBUG nova.network.neutron [req-a2cdc89b-43fa-49fd-9b66-2b695dc7a963 req-5f20bd65-599c-45fc-85fb-dbfaac437ebd service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Updated VIF entry in instance network info cache for port ec7cc688-a3a0-46a3-aa63-6e32ca5bf216. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:56:43 user nova-compute[74540]: DEBUG nova.network.neutron [req-a2cdc89b-43fa-49fd-9b66-2b695dc7a963 req-5f20bd65-599c-45fc-85fb-dbfaac437ebd service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Updating instance_info_cache with network_info: [{"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:56:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a2cdc89b-43fa-49fd-9b66-2b695dc7a963 req-5f20bd65-599c-45fc-85fb-dbfaac437ebd service nova] Releasing lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Successfully updated port: 27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquired lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updating instance_info_cache with network_info: [{"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Releasing lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Instance network_info: |[{"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c6d0ca09-398f-40ef-b2c6-a39c3ba0d082 req-ed09ebba-e2dc-4c2e-8a38-d1ada5dc26a8 service nova] Acquired lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.network.neutron [req-c6d0ca09-398f-40ef-b2c6-a39c3ba0d082 req-ed09ebba-e2dc-4c2e-8a38-d1ada5dc26a8 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Refreshing network info cache for port b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Start _get_guest_xml network_info=[{"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:56:44 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:44 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-7025ae17-c33c-4395-97f5-56e8f95eb781 req-41a14e0f-5e07-4d9f-b831-d81c632e73e7 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-changed-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-7025ae17-c33c-4395-97f5-56e8f95eb781 req-41a14e0f-5e07-4d9f-b831-d81c632e73e7 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Refreshing instance network info cache due to event network-changed-27e96706-586b-4c99-9b76-6073a1dda1c8. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7025ae17-c33c-4395-97f5-56e8f95eb781 req-41a14e0f-5e07-4d9f-b831-d81c632e73e7 service nova] Acquiring lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-270406895',display_name='tempest-ServerStableDeviceRescueTest-server-270406895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-270406895',id=3,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB73hKr0rCSaXcEdzAIV9bdsU5+khQO/C1hkKjkqXTy7pwY3QiFu4j8idpqpU2PBgsUP2QTfIFzopN/poLcBVGh0/WKe94Lh0RtHcChTpf0rxWKgCmEpAp0beMT3frmJpw==',key_name='tempest-keypair-672410008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20cf66849de49ce9591749b8a941d76',ramdisk_id='',reservation_id='r-ok1nm0rk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-700722702',owner_user_name='tempest-ServerStableDeviceRescueTest-700722702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1aae6f239de4d6994efd7eace1ceecc',uuid=5a9f46b2-f47c-44a7-9e54-aa167d6c720a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Converting VIF {"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:c8:7f,bridge_name='br-int',has_traffic_filtering=True,id=b624973a-ace1-47d7-8733-2a76e946eaec,network=Network(930b8cda-0528-4954-9f89-52be884a19fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624973a-ac') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.objects.instance [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:56:44 user nova-compute[74540]:   <uuid>5a9f46b2-f47c-44a7-9e54-aa167d6c720a</uuid>
Nov 07 03:56:44 user nova-compute[74540]:   <name>instance-00000003</name>
Nov 07 03:56:44 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:56:44 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:56:44 user nova-compute[74540]:   <metadata>
Nov 07 03:56:44 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:56:44 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:56:44 user nova-compute[74540]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-270406895</nova:name>
Nov 07 03:56:44 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:56:44</nova:creationTime>
Nov 07 03:56:44 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:56:44 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:56:44 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:56:44 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:56:44 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:56:44 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:56:44 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:56:44 user nova-compute[74540]:       <nova:owner>
Nov 07 03:56:44 user nova-compute[74540]:         <nova:user uuid="f1aae6f239de4d6994efd7eace1ceecc">tempest-ServerStableDeviceRescueTest-700722702-project-member</nova:user>
Nov 07 03:56:44 user nova-compute[74540]:         <nova:project uuid="f20cf66849de49ce9591749b8a941d76">tempest-ServerStableDeviceRescueTest-700722702</nova:project>
Nov 07 03:56:44 user nova-compute[74540]:       </nova:owner>
Nov 07 03:56:44 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 03:56:44 user nova-compute[74540]:       <nova:ports>
Nov 07 03:56:44 user nova-compute[74540]:         <nova:port uuid="b624973a-ace1-47d7-8733-2a76e946eaec">
Nov 07 03:56:44 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 03:56:44 user nova-compute[74540]:         </nova:port>
Nov 07 03:56:44 user nova-compute[74540]:       </nova:ports>
Nov 07 03:56:44 user nova-compute[74540]:     </nova:instance>
Nov 07 03:56:44 user nova-compute[74540]:   </metadata>
Nov 07 03:56:44 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:56:44 user nova-compute[74540]:     <system>
Nov 07 03:56:44 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:56:44 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:56:44 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:56:44 user nova-compute[74540]:       <entry name="serial">5a9f46b2-f47c-44a7-9e54-aa167d6c720a</entry>
Nov 07 03:56:44 user nova-compute[74540]:       <entry name="uuid">5a9f46b2-f47c-44a7-9e54-aa167d6c720a</entry>
Nov 07 03:56:44 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:56:44 user nova-compute[74540]:     </system>
Nov 07 03:56:44 user nova-compute[74540]:   </sysinfo>
Nov 07 03:56:44 user nova-compute[74540]:   <os>
Nov 07 03:56:44 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:56:44 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 03:56:44 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:56:44 user nova-compute[74540]:   </os>
Nov 07 03:56:44 user nova-compute[74540]:   <features>
Nov 07 03:56:44 user nova-compute[74540]:     <acpi/>
Nov 07 03:56:44 user nova-compute[74540]:     <apic/>
Nov 07 03:56:44 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:56:44 user nova-compute[74540]:   </features>
Nov 07 03:56:44 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:56:44 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:56:44 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:56:44 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:56:44 user nova-compute[74540]:   </clock>
Nov 07 03:56:44 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:56:44 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:56:44 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:56:44 user nova-compute[74540]:   </cpu>
Nov 07 03:56:44 user nova-compute[74540]:   <devices>
Nov 07 03:56:44 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 03:56:44 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 03:56:44 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk"/>
Nov 07 03:56:44 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 03:56:44 user nova-compute[74540]:     </disk>
Nov 07 03:56:44 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:56:44 user nova-compute[74540]:       <mac address="fa:16:3e:72:c8:7f"/>
Nov 07 03:56:44 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:56:44 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:56:44 user nova-compute[74540]:       <target dev="tapb624973a-ac"/>
Nov 07 03:56:44 user nova-compute[74540]:     </interface>
Nov 07 03:56:44 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:56:44 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/console.log" append="off"/>
Nov 07 03:56:44 user nova-compute[74540]:     </serial>
Nov 07 03:56:44 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:56:44 user nova-compute[74540]:     <video>
Nov 07 03:56:44 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:56:44 user nova-compute[74540]:     </video>
Nov 07 03:56:44 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:56:44 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:56:44 user nova-compute[74540]:     </rng>
Nov 07 03:56:44 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:56:44 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:56:44 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:56:44 user nova-compute[74540]:     </memballoon>
Nov 07 03:56:44 user nova-compute[74540]:   </devices>
Nov 07 03:56:44 user nova-compute[74540]: </domain>
Nov 07 03:56:44 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-270406895',display_name='tempest-ServerStableDeviceRescueTest-server-270406895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-270406895',id=3,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB73hKr0rCSaXcEdzAIV9bdsU5+khQO/C1hkKjkqXTy7pwY3QiFu4j8idpqpU2PBgsUP2QTfIFzopN/poLcBVGh0/WKe94Lh0RtHcChTpf0rxWKgCmEpAp0beMT3frmJpw==',key_name='tempest-keypair-672410008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f20cf66849de49ce9591749b8a941d76',ramdisk_id='',reservation_id='r-ok1nm0rk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-700722702',owner_user_name='tempest-ServerStableDeviceRescueTest-700722702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1aae6f239de4d6994efd7eace1ceecc',uuid=5a9f46b2-f47c-44a7-9e54-aa167d6c720a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Converting VIF {"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:c8:7f,bridge_name='br-int',has_traffic_filtering=True,id=b624973a-ace1-47d7-8733-2a76e946eaec,network=Network(930b8cda-0528-4954-9f89-52be884a19fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624973a-ac') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG os_vif [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:c8:7f,bridge_name='br-int',has_traffic_filtering=True,id=b624973a-ace1-47d7-8733-2a76e946eaec,network=Network(930b8cda-0528-4954-9f89-52be884a19fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624973a-ac') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e6d02e7-68fc-58c3-844c-9a3b389a06c0', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb624973a-ac, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb624973a-ac, col_values=(('qos', UUID('b55a61d5-dedf-4a19-83fe-acc574a22c6e')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb624973a-ac, col_values=(('external_ids', {'iface-id': 'b624973a-ace1-47d7-8733-2a76e946eaec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:c8:7f', 'vm-uuid': '5a9f46b2-f47c-44a7-9e54-aa167d6c720a'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:45 user nova-compute[74540]: INFO os_vif [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:c8:7f,bridge_name='br-int',has_traffic_filtering=True,id=b624973a-ace1-47d7-8733-2a76e946eaec,network=Network(930b8cda-0528-4954-9f89-52be884a19fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624973a-ac')
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] No VIF found with MAC fa:16:3e:72:c8:7f, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating instance_info_cache with network_info: [{"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Releasing lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Instance network_info: |[{"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7025ae17-c33c-4395-97f5-56e8f95eb781 req-41a14e0f-5e07-4d9f-b831-d81c632e73e7 service nova] Acquired lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.network.neutron [req-7025ae17-c33c-4395-97f5-56e8f95eb781 req-41a14e0f-5e07-4d9f-b831-d81c632e73e7 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Refreshing network info cache for port 27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Start _get_guest_xml network_info=[{"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:56:46 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:46 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1210052302',display_name='tempest-ServerActionsTestOtherB-server-1210052302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1210052302',id=4,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA4sa8gttNcUVG7dP3QNit/DgVEny+5q14Y5Nq4fULGEJH2XetZ4c/LpN/MeE1MeKbjuGhXIPyx37hOCdT8fI0kPAEfe6XDcs5qqFJVn5zBv9qgxSc44xeWnPbfk+DcLA==',key_name='tempest-keypair-1859375338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede989d4b3d34f1b996f135913039586',ramdisk_id='',reservation_id='r-kydyio2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-414073346',owner_user_name='tempest-ServerActionsTestOtherB-414073346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0218f41629a9468f80011fb04e917600',uuid=a3cae7a7-223c-438e-8206-39e0f1683cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converting VIF {"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lazy-loading 'pci_devices' on Instance uuid a3cae7a7-223c-438e-8206-39e0f1683cb0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:56:46 user nova-compute[74540]:   <uuid>a3cae7a7-223c-438e-8206-39e0f1683cb0</uuid>
Nov 07 03:56:46 user nova-compute[74540]:   <name>instance-00000004</name>
Nov 07 03:56:46 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:56:46 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:56:46 user nova-compute[74540]:   <metadata>
Nov 07 03:56:46 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:56:46 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:56:46 user nova-compute[74540]:       <nova:name>tempest-ServerActionsTestOtherB-server-1210052302</nova:name>
Nov 07 03:56:46 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:56:46</nova:creationTime>
Nov 07 03:56:46 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:56:46 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:56:46 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:56:46 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:56:46 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:56:46 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:56:46 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:56:46 user nova-compute[74540]:       <nova:owner>
Nov 07 03:56:46 user nova-compute[74540]:         <nova:user uuid="0218f41629a9468f80011fb04e917600">tempest-ServerActionsTestOtherB-414073346-project-member</nova:user>
Nov 07 03:56:46 user nova-compute[74540]:         <nova:project uuid="ede989d4b3d34f1b996f135913039586">tempest-ServerActionsTestOtherB-414073346</nova:project>
Nov 07 03:56:46 user nova-compute[74540]:       </nova:owner>
Nov 07 03:56:46 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 03:56:46 user nova-compute[74540]:       <nova:ports>
Nov 07 03:56:46 user nova-compute[74540]:         <nova:port uuid="27e96706-586b-4c99-9b76-6073a1dda1c8">
Nov 07 03:56:46 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 07 03:56:46 user nova-compute[74540]:         </nova:port>
Nov 07 03:56:46 user nova-compute[74540]:       </nova:ports>
Nov 07 03:56:46 user nova-compute[74540]:     </nova:instance>
Nov 07 03:56:46 user nova-compute[74540]:   </metadata>
Nov 07 03:56:46 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:56:46 user nova-compute[74540]:     <system>
Nov 07 03:56:46 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:56:46 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:56:46 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:56:46 user nova-compute[74540]:       <entry name="serial">a3cae7a7-223c-438e-8206-39e0f1683cb0</entry>
Nov 07 03:56:46 user nova-compute[74540]:       <entry name="uuid">a3cae7a7-223c-438e-8206-39e0f1683cb0</entry>
Nov 07 03:56:46 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:56:46 user nova-compute[74540]:     </system>
Nov 07 03:56:46 user nova-compute[74540]:   </sysinfo>
Nov 07 03:56:46 user nova-compute[74540]:   <os>
Nov 07 03:56:46 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:56:46 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 03:56:46 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:56:46 user nova-compute[74540]:   </os>
Nov 07 03:56:46 user nova-compute[74540]:   <features>
Nov 07 03:56:46 user nova-compute[74540]:     <acpi/>
Nov 07 03:56:46 user nova-compute[74540]:     <apic/>
Nov 07 03:56:46 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:56:46 user nova-compute[74540]:   </features>
Nov 07 03:56:46 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:56:46 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:56:46 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:56:46 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:56:46 user nova-compute[74540]:   </clock>
Nov 07 03:56:46 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:56:46 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:56:46 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:56:46 user nova-compute[74540]:   </cpu>
Nov 07 03:56:46 user nova-compute[74540]:   <devices>
Nov 07 03:56:46 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 03:56:46 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 03:56:46 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk"/>
Nov 07 03:56:46 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 03:56:46 user nova-compute[74540]:     </disk>
Nov 07 03:56:46 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:56:46 user nova-compute[74540]:       <mac address="fa:16:3e:6b:66:f7"/>
Nov 07 03:56:46 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:56:46 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:56:46 user nova-compute[74540]:       <target dev="tap27e96706-58"/>
Nov 07 03:56:46 user nova-compute[74540]:     </interface>
Nov 07 03:56:46 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:56:46 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/console.log" append="off"/>
Nov 07 03:56:46 user nova-compute[74540]:     </serial>
Nov 07 03:56:46 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:56:46 user nova-compute[74540]:     <video>
Nov 07 03:56:46 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:56:46 user nova-compute[74540]:     </video>
Nov 07 03:56:46 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:56:46 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:56:46 user nova-compute[74540]:     </rng>
Nov 07 03:56:46 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:56:46 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:56:46 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:56:46 user nova-compute[74540]:     </memballoon>
Nov 07 03:56:46 user nova-compute[74540]:   </devices>
Nov 07 03:56:46 user nova-compute[74540]: </domain>
Nov 07 03:56:46 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1210052302',display_name='tempest-ServerActionsTestOtherB-server-1210052302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1210052302',id=4,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA4sa8gttNcUVG7dP3QNit/DgVEny+5q14Y5Nq4fULGEJH2XetZ4c/LpN/MeE1MeKbjuGhXIPyx37hOCdT8fI0kPAEfe6XDcs5qqFJVn5zBv9qgxSc44xeWnPbfk+DcLA==',key_name='tempest-keypair-1859375338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede989d4b3d34f1b996f135913039586',ramdisk_id='',reservation_id='r-kydyio2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-414073346',owner_user_name='tempest-ServerActionsTestOtherB-414073346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0218f41629a9468f80011fb04e917600',uuid=a3cae7a7-223c-438e-8206-39e0f1683cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converting VIF {"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG os_vif [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fd51662-8103-509f-8fce-b6cb2ac043d4', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27e96706-58, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27e96706-58, col_values=(('qos', UUID('a875d202-028f-4e69-bea1-5094c89069d0')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27e96706-58, col_values=(('external_ids', {'iface-id': '27e96706-586b-4c99-9b76-6073a1dda1c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:66:f7', 'vm-uuid': 'a3cae7a7-223c-438e-8206-39e0f1683cb0'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:46 user nova-compute[74540]: INFO os_vif [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58')
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:56:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] No VIF found with MAC fa:16:3e:6b:66:f7, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG nova.network.neutron [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Successfully updated port: ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "refresh_cache-d6501f90-9180-4e99-a294-9ffba799c247" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquired lock "refresh_cache-d6501f90-9180-4e99-a294-9ffba799c247" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG nova.network.neutron [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-93e9e1d0-680c-4dda-940b-3f6cabe61d2f req-2c894c6d-fafd-4d2d-8b3d-2eb6d328c472 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Received event network-changed-ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-93e9e1d0-680c-4dda-940b-3f6cabe61d2f req-2c894c6d-fafd-4d2d-8b3d-2eb6d328c472 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Refreshing instance network info cache due to event network-changed-ec97afff-dfc2-423f-b6d9-7f0e807144d9. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-93e9e1d0-680c-4dda-940b-3f6cabe61d2f req-2c894c6d-fafd-4d2d-8b3d-2eb6d328c472 service nova] Acquiring lock "refresh_cache-d6501f90-9180-4e99-a294-9ffba799c247" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG nova.network.neutron [req-c6d0ca09-398f-40ef-b2c6-a39c3ba0d082 req-ed09ebba-e2dc-4c2e-8a38-d1ada5dc26a8 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updated VIF entry in instance network info cache for port b624973a-ace1-47d7-8733-2a76e946eaec. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG nova.network.neutron [req-c6d0ca09-398f-40ef-b2c6-a39c3ba0d082 req-ed09ebba-e2dc-4c2e-8a38-d1ada5dc26a8 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updating instance_info_cache with network_info: [{"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c6d0ca09-398f-40ef-b2c6-a39c3ba0d082 req-ed09ebba-e2dc-4c2e-8a38-d1ada5dc26a8 service nova] Releasing lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG nova.network.neutron [req-7025ae17-c33c-4395-97f5-56e8f95eb781 req-41a14e0f-5e07-4d9f-b831-d81c632e73e7 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updated VIF entry in instance network info cache for port 27e96706-586b-4c99-9b76-6073a1dda1c8. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG nova.network.neutron [req-7025ae17-c33c-4395-97f5-56e8f95eb781 req-41a14e0f-5e07-4d9f-b831-d81c632e73e7 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating instance_info_cache with network_info: [{"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7025ae17-c33c-4395-97f5-56e8f95eb781 req-41a14e0f-5e07-4d9f-b831-d81c632e73e7 service nova] Releasing lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:56:47 user nova-compute[74540]: DEBUG nova.network.neutron [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:56:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:48 user nova-compute[74540]: DEBUG nova.network.neutron [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Updating instance_info_cache with network_info: [{"id": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "address": "fa:16:3e:5c:97:16", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec97afff-df", "ovs_interfaceid": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:56:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Releasing lock "refresh_cache-d6501f90-9180-4e99-a294-9ffba799c247" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:56:48 user nova-compute[74540]: DEBUG nova.compute.manager [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Instance network_info: |[{"id": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "address": "fa:16:3e:5c:97:16", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec97afff-df", "ovs_interfaceid": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:56:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-93e9e1d0-680c-4dda-940b-3f6cabe61d2f req-2c894c6d-fafd-4d2d-8b3d-2eb6d328c472 service nova] Acquired lock "refresh_cache-d6501f90-9180-4e99-a294-9ffba799c247" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:56:48 user nova-compute[74540]: DEBUG nova.network.neutron [req-93e9e1d0-680c-4dda-940b-3f6cabe61d2f req-2c894c6d-fafd-4d2d-8b3d-2eb6d328c472 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Refreshing network info cache for port ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Start _get_guest_xml network_info=[{"id": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "address": "fa:16:3e:5c:97:16", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec97afff-df", "ovs_interfaceid": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:56:49 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:49 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-262183128',display_name='tempest-AttachVolumeNegativeTest-server-262183128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-262183128',id=5,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKpD6jUYS81AtBS3ueqZbGiPtxN7xY0V8Ks87Y2co8ZG740R4n2gTBhlxDBh22BOu1hvKLeyAPrb6+ywzuEhI6YajgPnJbKsQS4vVEyRtxm10Ym/BZQGU70LLdM6aY5qg==',key_name='tempest-keypair-1722906034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='620cefdadcec49d6a696aa7db8cef2d1',ramdisk_id='',reservation_id='r-eh638zor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-306463361',owner_user_name='tempest-AttachVolumeNegativeTest-306463361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3079ba3a84ea4b4bb4a3e576ab4133ae',uuid=d6501f90-9180-4e99-a294-9ffba799c247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "address": "fa:16:3e:5c:97:16", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec97afff-df", "ovs_interfaceid": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converting VIF {"id": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "address": "fa:16:3e:5c:97:16", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec97afff-df", "ovs_interfaceid": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:97:16,bridge_name='br-int',has_traffic_filtering=True,id=ec97afff-dfc2-423f-b6d9-7f0e807144d9,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec97afff-df') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.objects.instance [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'pci_devices' on Instance uuid d6501f90-9180-4e99-a294-9ffba799c247 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:56:49 user nova-compute[74540]:   <uuid>d6501f90-9180-4e99-a294-9ffba799c247</uuid>
Nov 07 03:56:49 user nova-compute[74540]:   <name>instance-00000005</name>
Nov 07 03:56:49 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:56:49 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:56:49 user nova-compute[74540]:   <metadata>
Nov 07 03:56:49 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:56:49 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:56:49 user nova-compute[74540]:       <nova:name>tempest-AttachVolumeNegativeTest-server-262183128</nova:name>
Nov 07 03:56:49 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:56:49</nova:creationTime>
Nov 07 03:56:49 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:56:49 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:56:49 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:56:49 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:56:49 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:56:49 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:56:49 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:56:49 user nova-compute[74540]:       <nova:owner>
Nov 07 03:56:49 user nova-compute[74540]:         <nova:user uuid="3079ba3a84ea4b4bb4a3e576ab4133ae">tempest-AttachVolumeNegativeTest-306463361-project-member</nova:user>
Nov 07 03:56:49 user nova-compute[74540]:         <nova:project uuid="620cefdadcec49d6a696aa7db8cef2d1">tempest-AttachVolumeNegativeTest-306463361</nova:project>
Nov 07 03:56:49 user nova-compute[74540]:       </nova:owner>
Nov 07 03:56:49 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 03:56:49 user nova-compute[74540]:       <nova:ports>
Nov 07 03:56:49 user nova-compute[74540]:         <nova:port uuid="ec97afff-dfc2-423f-b6d9-7f0e807144d9">
Nov 07 03:56:49 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 07 03:56:49 user nova-compute[74540]:         </nova:port>
Nov 07 03:56:49 user nova-compute[74540]:       </nova:ports>
Nov 07 03:56:49 user nova-compute[74540]:     </nova:instance>
Nov 07 03:56:49 user nova-compute[74540]:   </metadata>
Nov 07 03:56:49 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:56:49 user nova-compute[74540]:     <system>
Nov 07 03:56:49 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:56:49 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:56:49 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:56:49 user nova-compute[74540]:       <entry name="serial">d6501f90-9180-4e99-a294-9ffba799c247</entry>
Nov 07 03:56:49 user nova-compute[74540]:       <entry name="uuid">d6501f90-9180-4e99-a294-9ffba799c247</entry>
Nov 07 03:56:49 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:56:49 user nova-compute[74540]:     </system>
Nov 07 03:56:49 user nova-compute[74540]:   </sysinfo>
Nov 07 03:56:49 user nova-compute[74540]:   <os>
Nov 07 03:56:49 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:56:49 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 03:56:49 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:56:49 user nova-compute[74540]:   </os>
Nov 07 03:56:49 user nova-compute[74540]:   <features>
Nov 07 03:56:49 user nova-compute[74540]:     <acpi/>
Nov 07 03:56:49 user nova-compute[74540]:     <apic/>
Nov 07 03:56:49 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:56:49 user nova-compute[74540]:   </features>
Nov 07 03:56:49 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:56:49 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:56:49 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:56:49 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:56:49 user nova-compute[74540]:   </clock>
Nov 07 03:56:49 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:56:49 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:56:49 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:56:49 user nova-compute[74540]:   </cpu>
Nov 07 03:56:49 user nova-compute[74540]:   <devices>
Nov 07 03:56:49 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 03:56:49 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 03:56:49 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk"/>
Nov 07 03:56:49 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 03:56:49 user nova-compute[74540]:     </disk>
Nov 07 03:56:49 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:56:49 user nova-compute[74540]:       <mac address="fa:16:3e:5c:97:16"/>
Nov 07 03:56:49 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:56:49 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:56:49 user nova-compute[74540]:       <target dev="tapec97afff-df"/>
Nov 07 03:56:49 user nova-compute[74540]:     </interface>
Nov 07 03:56:49 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:56:49 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/console.log" append="off"/>
Nov 07 03:56:49 user nova-compute[74540]:     </serial>
Nov 07 03:56:49 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:56:49 user nova-compute[74540]:     <video>
Nov 07 03:56:49 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:56:49 user nova-compute[74540]:     </video>
Nov 07 03:56:49 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:56:49 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:56:49 user nova-compute[74540]:     </rng>
Nov 07 03:56:49 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:56:49 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:56:49 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:56:49 user nova-compute[74540]:     </memballoon>
Nov 07 03:56:49 user nova-compute[74540]:   </devices>
Nov 07 03:56:49 user nova-compute[74540]: </domain>
Nov 07 03:56:49 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-262183128',display_name='tempest-AttachVolumeNegativeTest-server-262183128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-262183128',id=5,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKpD6jUYS81AtBS3ueqZbGiPtxN7xY0V8Ks87Y2co8ZG740R4n2gTBhlxDBh22BOu1hvKLeyAPrb6+ywzuEhI6YajgPnJbKsQS4vVEyRtxm10Ym/BZQGU70LLdM6aY5qg==',key_name='tempest-keypair-1722906034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='620cefdadcec49d6a696aa7db8cef2d1',ramdisk_id='',reservation_id='r-eh638zor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-306463361',owner_user_name='tempest-AttachVolumeNegativeTest-306463361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3079ba3a84ea4b4bb4a3e576ab4133ae',uuid=d6501f90-9180-4e99-a294-9ffba799c247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "address": "fa:16:3e:5c:97:16", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec97afff-df", "ovs_interfaceid": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converting VIF {"id": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "address": "fa:16:3e:5c:97:16", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec97afff-df", "ovs_interfaceid": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:97:16,bridge_name='br-int',has_traffic_filtering=True,id=ec97afff-dfc2-423f-b6d9-7f0e807144d9,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec97afff-df') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG os_vif [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:97:16,bridge_name='br-int',has_traffic_filtering=True,id=ec97afff-dfc2-423f-b6d9-7f0e807144d9,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec97afff-df') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51a6781d-2455-5aa5-910a-f07a798e2b97', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec97afff-df, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec97afff-df, col_values=(('qos', UUID('15e77147-27a4-4917-96f6-ebe2018a344d')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec97afff-df, col_values=(('external_ids', {'iface-id': 'ec97afff-dfc2-423f-b6d9-7f0e807144d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:97:16', 'vm-uuid': 'd6501f90-9180-4e99-a294-9ffba799c247'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:49 user nova-compute[74540]: INFO os_vif [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:97:16,bridge_name='br-int',has_traffic_filtering=True,id=ec97afff-dfc2-423f-b6d9-7f0e807144d9,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec97afff-df')
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No VIF found with MAC fa:16:3e:5c:97:16, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 03:56:49 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Instance spawned successfully.
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "6d43f26f-dfbb-4299-b875-f498979679d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:49 user nova-compute[74540]: INFO nova.compute.manager [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Took 16.51 seconds to spawn the instance on the hypervisor.
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:50 user nova-compute[74540]: INFO nova.compute.manager [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Took 17.81 seconds to build instance.
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:56:50 user nova-compute[74540]: INFO nova.compute.claims [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Claim successful on node user
Nov 07 03:56:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7266567a-4aea-4cbb-976e-0b7404255629 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.004s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 03:56:50 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Instance spawned successfully.
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:50 user nova-compute[74540]: INFO nova.compute.manager [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Took 15.54 seconds to spawn the instance on the hypervisor.
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.network.neutron [req-93e9e1d0-680c-4dda-940b-3f6cabe61d2f req-2c894c6d-fafd-4d2d-8b3d-2eb6d328c472 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Updated VIF entry in instance network info cache for port ec97afff-dfc2-423f-b6d9-7f0e807144d9. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.network.neutron [req-93e9e1d0-680c-4dda-940b-3f6cabe61d2f req-2c894c6d-fafd-4d2d-8b3d-2eb6d328c472 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Updating instance_info_cache with network_info: [{"id": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "address": "fa:16:3e:5c:97:16", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec97afff-df", "ovs_interfaceid": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-93e9e1d0-680c-4dda-940b-3f6cabe61d2f req-2c894c6d-fafd-4d2d-8b3d-2eb6d328c472 service nova] Releasing lock "refresh_cache-d6501f90-9180-4e99-a294-9ffba799c247" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:50 user nova-compute[74540]: INFO nova.compute.manager [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Took 16.46 seconds to build instance.
Nov 07 03:56:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.791s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43be2abc-f9c7-4352-9d53-4f7062158f79 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.599s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:56:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:56:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 03:56:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:56:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Creating image(s)
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "/opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "/opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG nova.policy [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72436e7806974d159635dc3d86785dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22541886dbac4b43a412699358e12f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.320s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.250s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk 1073741824" returned: 0 in 0.074s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.250s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Cannot resize image /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Ensure instance console log exists: /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Successfully created port: 93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:56:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 03:56:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 03:56:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Instance spawned successfully.
Nov 07 03:56:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 03:56:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 03:56:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 03:56:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Instance spawned successfully.
Nov 07 03:56:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 03:56:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:54 user nova-compute[74540]: INFO nova.compute.manager [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Took 15.20 seconds to spawn the instance on the hypervisor.
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:56:54 user nova-compute[74540]: INFO nova.compute.manager [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Took 17.24 seconds to spawn the instance on the hypervisor.
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Successfully updated port: 93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "refresh_cache-6d43f26f-dfbb-4299-b875-f498979679d9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquired lock "refresh_cache-6d43f26f-dfbb-4299-b875-f498979679d9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-d43daeb1-c438-43d3-ab2d-d566ab17a998 req-efe8592d-3c9e-45ed-820a-583cbc12986f service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received event network-changed-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-d43daeb1-c438-43d3-ab2d-d566ab17a998 req-efe8592d-3c9e-45ed-820a-583cbc12986f service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Refreshing instance network info cache due to event network-changed-93c295a9-0e82-4a04-9eab-7dea70ad507c. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d43daeb1-c438-43d3-ab2d-d566ab17a998 req-efe8592d-3c9e-45ed-820a-583cbc12986f service nova] Acquiring lock "refresh_cache-6d43f26f-dfbb-4299-b875-f498979679d9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:56:54 user nova-compute[74540]: INFO nova.compute.manager [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Took 16.13 seconds to build instance.
Nov 07 03:56:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f8618127-a2b4-4c47-9768-621b09ff202d tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.305s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:54 user nova-compute[74540]: INFO nova.compute.manager [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Took 18.40 seconds to build instance.
Nov 07 03:56:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd81be25-6061-4e95-9e85-5662f07e7f4b tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.624s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 03:56:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Instance spawned successfully.
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:56:54 user nova-compute[74540]: INFO nova.compute.manager [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Took 15.25 seconds to spawn the instance on the hypervisor.
Nov 07 03:56:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:55 user nova-compute[74540]: INFO nova.compute.manager [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Took 16.40 seconds to build instance.
Nov 07 03:56:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1fc7139c-9c01-4d2a-a1a2-167d74d58d87 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "d6501f90-9180-4e99-a294-9ffba799c247" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.518s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Updating instance_info_cache with network_info: [{"id": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "address": "fa:16:3e:48:2e:c5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c295a9-0e", "ovs_interfaceid": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Releasing lock "refresh_cache-6d43f26f-dfbb-4299-b875-f498979679d9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Instance network_info: |[{"id": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "address": "fa:16:3e:48:2e:c5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c295a9-0e", "ovs_interfaceid": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d43daeb1-c438-43d3-ab2d-d566ab17a998 req-efe8592d-3c9e-45ed-820a-583cbc12986f service nova] Acquired lock "refresh_cache-6d43f26f-dfbb-4299-b875-f498979679d9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.network.neutron [req-d43daeb1-c438-43d3-ab2d-d566ab17a998 req-efe8592d-3c9e-45ed-820a-583cbc12986f service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Refreshing network info cache for port 93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Start _get_guest_xml network_info=[{"id": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "address": "fa:16:3e:48:2e:c5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c295a9-0e", "ovs_interfaceid": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:56:55 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:55 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1528697524',display_name='tempest-VolumesAdminNegativeTest-server-1528697524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1528697524',id=6,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkBJnzeV/EgUJz1TOfRnbqbs/0u7gpVXu0e6c0J7Uzcu4LFs2w0abfAE6U05a165ZTzRMtQPNqMalXGNGUhz227T7ZBYa+MgXLBEKkhmBWe0A8l97utGO9HnRnfm3XtoQ==',key_name='tempest-keypair-1821227745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22541886dbac4b43a412699358e12f25',ramdisk_id='',reservation_id='r-ss4ea0m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1758788930',owner_user_name='tempest-VolumesAdminNegativeTest-1758788930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72436e7806974d159635dc3d86785dff',uuid=6d43f26f-dfbb-4299-b875-f498979679d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "address": "fa:16:3e:48:2e:c5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c295a9-0e", "ovs_interfaceid": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Converting VIF {"id": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "address": "fa:16:3e:48:2e:c5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c295a9-0e", "ovs_interfaceid": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:2e:c5,bridge_name='br-int',has_traffic_filtering=True,id=93c295a9-0e82-4a04-9eab-7dea70ad507c,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c295a9-0e') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d43f26f-dfbb-4299-b875-f498979679d9 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:56:55 user nova-compute[74540]:   <uuid>6d43f26f-dfbb-4299-b875-f498979679d9</uuid>
Nov 07 03:56:55 user nova-compute[74540]:   <name>instance-00000006</name>
Nov 07 03:56:55 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:56:55 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:56:55 user nova-compute[74540]:   <metadata>
Nov 07 03:56:55 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:56:55 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:56:55 user nova-compute[74540]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1528697524</nova:name>
Nov 07 03:56:55 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:56:55</nova:creationTime>
Nov 07 03:56:55 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:56:55 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:56:55 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:56:55 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:56:55 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:56:55 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:56:55 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:56:55 user nova-compute[74540]:       <nova:owner>
Nov 07 03:56:55 user nova-compute[74540]:         <nova:user uuid="72436e7806974d159635dc3d86785dff">tempest-VolumesAdminNegativeTest-1758788930-project-member</nova:user>
Nov 07 03:56:55 user nova-compute[74540]:         <nova:project uuid="22541886dbac4b43a412699358e12f25">tempest-VolumesAdminNegativeTest-1758788930</nova:project>
Nov 07 03:56:55 user nova-compute[74540]:       </nova:owner>
Nov 07 03:56:55 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 03:56:55 user nova-compute[74540]:       <nova:ports>
Nov 07 03:56:55 user nova-compute[74540]:         <nova:port uuid="93c295a9-0e82-4a04-9eab-7dea70ad507c">
Nov 07 03:56:55 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 07 03:56:55 user nova-compute[74540]:         </nova:port>
Nov 07 03:56:55 user nova-compute[74540]:       </nova:ports>
Nov 07 03:56:55 user nova-compute[74540]:     </nova:instance>
Nov 07 03:56:55 user nova-compute[74540]:   </metadata>
Nov 07 03:56:55 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:56:55 user nova-compute[74540]:     <system>
Nov 07 03:56:55 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:56:55 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:56:55 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:56:55 user nova-compute[74540]:       <entry name="serial">6d43f26f-dfbb-4299-b875-f498979679d9</entry>
Nov 07 03:56:55 user nova-compute[74540]:       <entry name="uuid">6d43f26f-dfbb-4299-b875-f498979679d9</entry>
Nov 07 03:56:55 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:56:55 user nova-compute[74540]:     </system>
Nov 07 03:56:55 user nova-compute[74540]:   </sysinfo>
Nov 07 03:56:55 user nova-compute[74540]:   <os>
Nov 07 03:56:55 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:56:55 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 03:56:55 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:56:55 user nova-compute[74540]:   </os>
Nov 07 03:56:55 user nova-compute[74540]:   <features>
Nov 07 03:56:55 user nova-compute[74540]:     <acpi/>
Nov 07 03:56:55 user nova-compute[74540]:     <apic/>
Nov 07 03:56:55 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:56:55 user nova-compute[74540]:   </features>
Nov 07 03:56:55 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:56:55 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:56:55 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:56:55 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:56:55 user nova-compute[74540]:   </clock>
Nov 07 03:56:55 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:56:55 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:56:55 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:56:55 user nova-compute[74540]:   </cpu>
Nov 07 03:56:55 user nova-compute[74540]:   <devices>
Nov 07 03:56:55 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 03:56:55 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 03:56:55 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk"/>
Nov 07 03:56:55 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 03:56:55 user nova-compute[74540]:     </disk>
Nov 07 03:56:55 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:56:55 user nova-compute[74540]:       <mac address="fa:16:3e:48:2e:c5"/>
Nov 07 03:56:55 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:56:55 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:56:55 user nova-compute[74540]:       <target dev="tap93c295a9-0e"/>
Nov 07 03:56:55 user nova-compute[74540]:     </interface>
Nov 07 03:56:55 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:56:55 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/console.log" append="off"/>
Nov 07 03:56:55 user nova-compute[74540]:     </serial>
Nov 07 03:56:55 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:56:55 user nova-compute[74540]:     <video>
Nov 07 03:56:55 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:56:55 user nova-compute[74540]:     </video>
Nov 07 03:56:55 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:56:55 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:56:55 user nova-compute[74540]:     </rng>
Nov 07 03:56:55 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:56:55 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:56:55 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:56:55 user nova-compute[74540]:     </memballoon>
Nov 07 03:56:55 user nova-compute[74540]:   </devices>
Nov 07 03:56:55 user nova-compute[74540]: </domain>
Nov 07 03:56:55 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1528697524',display_name='tempest-VolumesAdminNegativeTest-server-1528697524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1528697524',id=6,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkBJnzeV/EgUJz1TOfRnbqbs/0u7gpVXu0e6c0J7Uzcu4LFs2w0abfAE6U05a165ZTzRMtQPNqMalXGNGUhz227T7ZBYa+MgXLBEKkhmBWe0A8l97utGO9HnRnfm3XtoQ==',key_name='tempest-keypair-1821227745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22541886dbac4b43a412699358e12f25',ramdisk_id='',reservation_id='r-ss4ea0m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1758788930',owner_user_name='tempest-VolumesAdminNegativeTest-1758788930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72436e7806974d159635dc3d86785dff',uuid=6d43f26f-dfbb-4299-b875-f498979679d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "address": "fa:16:3e:48:2e:c5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c295a9-0e", "ovs_interfaceid": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Converting VIF {"id": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "address": "fa:16:3e:48:2e:c5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c295a9-0e", "ovs_interfaceid": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:2e:c5,bridge_name='br-int',has_traffic_filtering=True,id=93c295a9-0e82-4a04-9eab-7dea70ad507c,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c295a9-0e') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG os_vif [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:2e:c5,bridge_name='br-int',has_traffic_filtering=True,id=93c295a9-0e82-4a04-9eab-7dea70ad507c,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c295a9-0e') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8d28a4c-45e5-51a0-87e1-fb8495f58421', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93c295a9-0e, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93c295a9-0e, col_values=(('qos', UUID('df6ceb5c-03e0-4d54-a74d-ea9e1c7326ff')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93c295a9-0e, col_values=(('external_ids', {'iface-id': '93c295a9-0e82-4a04-9eab-7dea70ad507c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:2e:c5', 'vm-uuid': '6d43f26f-dfbb-4299-b875-f498979679d9'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:55 user nova-compute[74540]: INFO os_vif [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:2e:c5,bridge_name='br-int',has_traffic_filtering=True,id=93c295a9-0e82-4a04-9eab-7dea70ad507c,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c295a9-0e')
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:56:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] No VIF found with MAC fa:16:3e:48:2e:c5, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:56:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:56 user nova-compute[74540]: DEBUG nova.network.neutron [req-d43daeb1-c438-43d3-ab2d-d566ab17a998 req-efe8592d-3c9e-45ed-820a-583cbc12986f service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Updated VIF entry in instance network info cache for port 93c295a9-0e82-4a04-9eab-7dea70ad507c. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:56:56 user nova-compute[74540]: DEBUG nova.network.neutron [req-d43daeb1-c438-43d3-ab2d-d566ab17a998 req-efe8592d-3c9e-45ed-820a-583cbc12986f service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Updating instance_info_cache with network_info: [{"id": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "address": "fa:16:3e:48:2e:c5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c295a9-0e", "ovs_interfaceid": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:56:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d43daeb1-c438-43d3-ab2d-d566ab17a998 req-efe8592d-3c9e-45ed-820a-583cbc12986f service nova] Releasing lock "refresh_cache-6d43f26f-dfbb-4299-b875-f498979679d9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:56:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-c7453b11-f59d-4726-88b0-1dce36b985fb req-d82ed9aa-3bad-42d2-8eb9-c450f237f2c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:56:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7453b11-f59d-4726-88b0-1dce36b985fb req-d82ed9aa-3bad-42d2-8eb9-c450f237f2c2 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:56:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7453b11-f59d-4726-88b0-1dce36b985fb req-d82ed9aa-3bad-42d2-8eb9-c450f237f2c2 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:56:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7453b11-f59d-4726-88b0-1dce36b985fb req-d82ed9aa-3bad-42d2-8eb9-c450f237f2c2 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:56:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-c7453b11-f59d-4726-88b0-1dce36b985fb req-d82ed9aa-3bad-42d2-8eb9-c450f237f2c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:56:58 user nova-compute[74540]: WARNING nova.compute.manager [req-c7453b11-f59d-4726-88b0-1dce36b985fb req-d82ed9aa-3bad-42d2-8eb9-c450f237f2c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state active and task_state None.
Nov 07 03:56:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:56:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 03:57:00 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Instance spawned successfully.
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:00 user nova-compute[74540]: WARNING nova.compute.manager [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state active and task_state None.
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] No waiting events found dispatching network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:00 user nova-compute[74540]: WARNING nova.compute.manager [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received unexpected event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 for instance with vm_state active and task_state None.
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] No waiting events found dispatching network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:00 user nova-compute[74540]: WARNING nova.compute.manager [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received unexpected event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 for instance with vm_state active and task_state None.
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Received event network-vif-plugged-ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] Acquiring lock "d6501f90-9180-4e99-a294-9ffba799c247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] Lock "d6501f90-9180-4e99-a294-9ffba799c247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] Lock "d6501f90-9180-4e99-a294-9ffba799c247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] No waiting events found dispatching network-vif-plugged-ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:00 user nova-compute[74540]: WARNING nova.compute.manager [req-f8dde151-d08c-4448-94cb-a5fcf006ba0e req-5ac358bb-c32f-4a23-a188-842e0b537e3e service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Received unexpected event network-vif-plugged-ec97afff-dfc2-423f-b6d9-7f0e807144d9 for instance with vm_state active and task_state None.
Nov 07 03:57:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:00 user nova-compute[74540]: INFO nova.compute.manager [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Took 9.37 seconds to spawn the instance on the hypervisor.
Nov 07 03:57:00 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:57:00 user nova-compute[74540]: INFO nova.compute.manager [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Took 10.85 seconds to build instance.
Nov 07 03:57:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fb9bf68-f946-452d-ade5-324478c34d2b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "6d43f26f-dfbb-4299-b875-f498979679d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.188s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:01 user nova-compute[74540]: DEBUG nova.compute.manager [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:57:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:01 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:57:01 user nova-compute[74540]: INFO nova.compute.claims [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Claim successful on node user
Nov 07 03:57:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-d1cdf54a-76bf-4f53-8ce8-4c071fffe11e req-c35d8c37-8b5b-4711-a1c1-472b7994f0b9 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Received event network-vif-plugged-ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d1cdf54a-76bf-4f53-8ce8-4c071fffe11e req-c35d8c37-8b5b-4711-a1c1-472b7994f0b9 service nova] Acquiring lock "d6501f90-9180-4e99-a294-9ffba799c247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d1cdf54a-76bf-4f53-8ce8-4c071fffe11e req-c35d8c37-8b5b-4711-a1c1-472b7994f0b9 service nova] Lock "d6501f90-9180-4e99-a294-9ffba799c247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d1cdf54a-76bf-4f53-8ce8-4c071fffe11e req-c35d8c37-8b5b-4711-a1c1-472b7994f0b9 service nova] Lock "d6501f90-9180-4e99-a294-9ffba799c247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-d1cdf54a-76bf-4f53-8ce8-4c071fffe11e req-c35d8c37-8b5b-4711-a1c1-472b7994f0b9 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] No waiting events found dispatching network-vif-plugged-ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:02 user nova-compute[74540]: WARNING nova.compute.manager [req-d1cdf54a-76bf-4f53-8ce8-4c071fffe11e req-c35d8c37-8b5b-4711-a1c1-472b7994f0b9 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Received unexpected event network-vif-plugged-ec97afff-dfc2-423f-b6d9-7f0e807144d9 for instance with vm_state active and task_state None.
Nov 07 03:57:02 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:57:02 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:57:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.795s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:57:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:57:02 user nova-compute[74540]: DEBUG nova.network.neutron [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:57:02 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 07 03:57:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:57:03 user nova-compute[74540]: DEBUG nova.policy [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a51748f5c554aee820cf07dfe3883a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9165dbae4d9448d6adba10e82cbfc624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:57:03 user nova-compute[74540]: DEBUG nova.compute.manager [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:57:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:57:03 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Creating image(s)
Nov 07 03:57:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "/opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "/opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "fd4daa67cef396176fb29a99dc9e98ee5e1ea817" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "fd4daa67cef396176fb29a99dc9e98ee5e1ea817" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817.part --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG nova.network.neutron [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Successfully created port: d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817.part --force-share --output=json" returned: 0 in 0.314s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG nova.virt.images [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] 71ec3b79-a312-4d68-aa41-fc70d1c4fd3a was qcow2, converting to raw {{(pid=74540) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817.part /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817.converted {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817.part /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817.converted" returned: 0 in 0.270s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817.converted --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817.converted --force-share --output=json" returned: 0 in 0.231s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "fd4daa67cef396176fb29a99dc9e98ee5e1ea817" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.508s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG nova.network.neutron [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Successfully updated port: d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "refresh_cache-8c37887f-4c8a-4808-82a7-f8701dd9b62e" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquired lock "refresh_cache-8c37887f-4c8a-4808-82a7-f8701dd9b62e" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG nova.network.neutron [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817 --force-share --output=json" returned: 0 in 0.251s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "fd4daa67cef396176fb29a99dc9e98ee5e1ea817" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "fd4daa67cef396176fb29a99dc9e98ee5e1ea817" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-ad6dc91a-3b85-4a56-92f1-586de319b0d1 req-9884d9e7-6626-47b6-a9db-f1749ec54971 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Received event network-changed-d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-ad6dc91a-3b85-4a56-92f1-586de319b0d1 req-9884d9e7-6626-47b6-a9db-f1749ec54971 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Refreshing instance network info cache due to event network-changed-d711d258-7e53-4467-93ca-6ed95045095a. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ad6dc91a-3b85-4a56-92f1-586de319b0d1 req-9884d9e7-6626-47b6-a9db-f1749ec54971 service nova] Acquiring lock "refresh_cache-8c37887f-4c8a-4808-82a7-f8701dd9b62e" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG nova.network.neutron [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:57:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817 --force-share --output=json" returned: 0 in 0.271s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817,backing_fmt=raw /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817,backing_fmt=raw /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk 1073741824" returned: 0 in 0.073s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "fd4daa67cef396176fb29a99dc9e98ee5e1ea817" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.network.neutron [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Updating instance_info_cache with network_info: [{"id": "d711d258-7e53-4467-93ca-6ed95045095a", "address": "fa:16:3e:06:0d:dc", "network": {"id": "9397df5e-5494-42e9-b228-e6e56895fd13", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1555022831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9165dbae4d9448d6adba10e82cbfc624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd711d258-7e", "ovs_interfaceid": "d711d258-7e53-4467-93ca-6ed95045095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Releasing lock "refresh_cache-8c37887f-4c8a-4808-82a7-f8701dd9b62e" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.compute.manager [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Instance network_info: |[{"id": "d711d258-7e53-4467-93ca-6ed95045095a", "address": "fa:16:3e:06:0d:dc", "network": {"id": "9397df5e-5494-42e9-b228-e6e56895fd13", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1555022831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9165dbae4d9448d6adba10e82cbfc624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd711d258-7e", "ovs_interfaceid": "d711d258-7e53-4467-93ca-6ed95045095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ad6dc91a-3b85-4a56-92f1-586de319b0d1 req-9884d9e7-6626-47b6-a9db-f1749ec54971 service nova] Acquired lock "refresh_cache-8c37887f-4c8a-4808-82a7-f8701dd9b62e" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.network.neutron [req-ad6dc91a-3b85-4a56-92f1-586de319b0d1 req-9884d9e7-6626-47b6-a9db-f1749ec54971 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Refreshing network info cache for port d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817 --force-share --output=json" returned: 0 in 0.237s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "5d248eae-ef06-4be3-9178-15d54309be59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "5d248eae-ef06-4be3-9178-15d54309be59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.compute.manager [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Cannot resize image /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Ensure instance console log exists: /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Start _get_guest_xml network_info=[{"id": "d711d258-7e53-4467-93ca-6ed95045095a", "address": "fa:16:3e:06:0d:dc", "network": {"id": "9397df5e-5494-42e9-b228-e6e56895fd13", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1555022831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9165dbae4d9448d6adba10e82cbfc624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd711d258-7e", "ovs_interfaceid": "d711d258-7e53-4467-93ca-6ed95045095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:56:53Z,direct_url=<?>,disk_format='qcow2',id=71ec3b79-a312-4d68-aa41-fc70d1c4fd3a,min_disk=0,min_ram=0,name='',owner='783d522e585446998bff0d461bacc178',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:56:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'device_type': 'disk', 'guest_format': None, 'image_id': '71ec3b79-a312-4d68-aa41-fc70d1c4fd3a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:57:05 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:57:05 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:56:53Z,direct_url=<?>,disk_format='qcow2',id=71ec3b79-a312-4d68-aa41-fc70d1c4fd3a,min_disk=0,min_ram=0,name='',owner='783d522e585446998bff0d461bacc178',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:56:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1505121729',display_name='tempest-AttachSCSIVolumeTestJSON-server-1505121729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1505121729',id=7,image_ref='71ec3b79-a312-4d68-aa41-fc70d1c4fd3a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQSaEGTymH5++JQ4ijpLImrZkPHTlnxcj95cjU7Ani9W/fWYtrr5I8Q7k9A2iW9yAgo7PlVITpn0+hwpFPgZM26nEXqPGzz4UpVgZnHx5tna9UA5KmBWpOhDTyzW+AiCg==',key_name='tempest-keypair-1842096411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9165dbae4d9448d6adba10e82cbfc624',ramdisk_id='',reservation_id='r-u3xdqloq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='71ec3b79-a312-4d68-aa41-fc70d1c4fd3a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-75211980',owner_user_name='tempest-AttachSCSIVolumeTestJSON-75211980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:57:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a51748f5c554aee820cf07dfe3883a0',uuid=8c37887f-4c8a-4808-82a7-f8701dd9b62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d711d258-7e53-4467-93ca-6ed95045095a", "address": "fa:16:3e:06:0d:dc", "network": {"id": "9397df5e-5494-42e9-b228-e6e56895fd13", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1555022831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9165dbae4d9448d6adba10e82cbfc624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd711d258-7e", "ovs_interfaceid": "d711d258-7e53-4467-93ca-6ed95045095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Converting VIF {"id": "d711d258-7e53-4467-93ca-6ed95045095a", "address": "fa:16:3e:06:0d:dc", "network": {"id": "9397df5e-5494-42e9-b228-e6e56895fd13", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1555022831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9165dbae4d9448d6adba10e82cbfc624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd711d258-7e", "ovs_interfaceid": "d711d258-7e53-4467-93ca-6ed95045095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=d711d258-7e53-4467-93ca-6ed95045095a,network=Network(9397df5e-5494-42e9-b228-e6e56895fd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd711d258-7e') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.objects.instance [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c37887f-4c8a-4808-82a7-f8701dd9b62e {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:57:05 user nova-compute[74540]:   <uuid>8c37887f-4c8a-4808-82a7-f8701dd9b62e</uuid>
Nov 07 03:57:05 user nova-compute[74540]:   <name>instance-00000007</name>
Nov 07 03:57:05 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:57:05 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:57:05 user nova-compute[74540]:   <metadata>
Nov 07 03:57:05 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:57:05 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:57:05 user nova-compute[74540]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1505121729</nova:name>
Nov 07 03:57:05 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:57:05</nova:creationTime>
Nov 07 03:57:05 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:57:05 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:57:05 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:57:05 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:57:05 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:57:05 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:57:05 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:57:05 user nova-compute[74540]:       <nova:owner>
Nov 07 03:57:05 user nova-compute[74540]:         <nova:user uuid="5a51748f5c554aee820cf07dfe3883a0">tempest-AttachSCSIVolumeTestJSON-75211980-project-member</nova:user>
Nov 07 03:57:05 user nova-compute[74540]:         <nova:project uuid="9165dbae4d9448d6adba10e82cbfc624">tempest-AttachSCSIVolumeTestJSON-75211980</nova:project>
Nov 07 03:57:05 user nova-compute[74540]:       </nova:owner>
Nov 07 03:57:05 user nova-compute[74540]:       <nova:root type="image" uuid="71ec3b79-a312-4d68-aa41-fc70d1c4fd3a"/>
Nov 07 03:57:05 user nova-compute[74540]:       <nova:ports>
Nov 07 03:57:05 user nova-compute[74540]:         <nova:port uuid="d711d258-7e53-4467-93ca-6ed95045095a">
Nov 07 03:57:05 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 03:57:05 user nova-compute[74540]:         </nova:port>
Nov 07 03:57:05 user nova-compute[74540]:       </nova:ports>
Nov 07 03:57:05 user nova-compute[74540]:     </nova:instance>
Nov 07 03:57:05 user nova-compute[74540]:   </metadata>
Nov 07 03:57:05 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:57:05 user nova-compute[74540]:     <system>
Nov 07 03:57:05 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:57:05 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:57:05 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:57:05 user nova-compute[74540]:       <entry name="serial">8c37887f-4c8a-4808-82a7-f8701dd9b62e</entry>
Nov 07 03:57:05 user nova-compute[74540]:       <entry name="uuid">8c37887f-4c8a-4808-82a7-f8701dd9b62e</entry>
Nov 07 03:57:05 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:57:05 user nova-compute[74540]:     </system>
Nov 07 03:57:05 user nova-compute[74540]:   </sysinfo>
Nov 07 03:57:05 user nova-compute[74540]:   <os>
Nov 07 03:57:05 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:57:05 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 03:57:05 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:57:05 user nova-compute[74540]:   </os>
Nov 07 03:57:05 user nova-compute[74540]:   <features>
Nov 07 03:57:05 user nova-compute[74540]:     <acpi/>
Nov 07 03:57:05 user nova-compute[74540]:     <apic/>
Nov 07 03:57:05 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:57:05 user nova-compute[74540]:   </features>
Nov 07 03:57:05 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:57:05 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:57:05 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:57:05 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:57:05 user nova-compute[74540]:   </clock>
Nov 07 03:57:05 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:57:05 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:57:05 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:57:05 user nova-compute[74540]:   </cpu>
Nov 07 03:57:05 user nova-compute[74540]:   <devices>
Nov 07 03:57:05 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 03:57:05 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 03:57:05 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk"/>
Nov 07 03:57:05 user nova-compute[74540]:       <target dev="sda" bus="scsi"/>
Nov 07 03:57:05 user nova-compute[74540]:       <address type="drive" controller="0" unit="0"/>
Nov 07 03:57:05 user nova-compute[74540]:     </disk>
Nov 07 03:57:05 user nova-compute[74540]:     <disk type="file" device="cdrom">
Nov 07 03:57:05 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none"/>
Nov 07 03:57:05 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk.config"/>
Nov 07 03:57:05 user nova-compute[74540]:       <target dev="sdb" bus="scsi"/>
Nov 07 03:57:05 user nova-compute[74540]:       <address type="drive" controller="0" unit="1"/>
Nov 07 03:57:05 user nova-compute[74540]:     </disk>
Nov 07 03:57:05 user nova-compute[74540]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 07 03:57:05 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:57:05 user nova-compute[74540]:       <mac address="fa:16:3e:06:0d:dc"/>
Nov 07 03:57:05 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:57:05 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:57:05 user nova-compute[74540]:       <target dev="tapd711d258-7e"/>
Nov 07 03:57:05 user nova-compute[74540]:     </interface>
Nov 07 03:57:05 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:57:05 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/console.log" append="off"/>
Nov 07 03:57:05 user nova-compute[74540]:     </serial>
Nov 07 03:57:05 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:57:05 user nova-compute[74540]:     <video>
Nov 07 03:57:05 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:57:05 user nova-compute[74540]:     </video>
Nov 07 03:57:05 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:57:05 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:57:05 user nova-compute[74540]:     </rng>
Nov 07 03:57:05 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:57:05 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:57:05 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:57:05 user nova-compute[74540]:     </memballoon>
Nov 07 03:57:05 user nova-compute[74540]:   </devices>
Nov 07 03:57:05 user nova-compute[74540]: </domain>
Nov 07 03:57:05 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1505121729',display_name='tempest-AttachSCSIVolumeTestJSON-server-1505121729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1505121729',id=7,image_ref='71ec3b79-a312-4d68-aa41-fc70d1c4fd3a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQSaEGTymH5++JQ4ijpLImrZkPHTlnxcj95cjU7Ani9W/fWYtrr5I8Q7k9A2iW9yAgo7PlVITpn0+hwpFPgZM26nEXqPGzz4UpVgZnHx5tna9UA5KmBWpOhDTyzW+AiCg==',key_name='tempest-keypair-1842096411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9165dbae4d9448d6adba10e82cbfc624',ramdisk_id='',reservation_id='r-u3xdqloq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='71ec3b79-a312-4d68-aa41-fc70d1c4fd3a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-75211980',owner_user_name='tempest-AttachSCSIVolumeTestJSON-75211980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:57:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a51748f5c554aee820cf07dfe3883a0',uuid=8c37887f-4c8a-4808-82a7-f8701dd9b62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d711d258-7e53-4467-93ca-6ed95045095a", "address": "fa:16:3e:06:0d:dc", "network": {"id": "9397df5e-5494-42e9-b228-e6e56895fd13", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1555022831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9165dbae4d9448d6adba10e82cbfc624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd711d258-7e", "ovs_interfaceid": "d711d258-7e53-4467-93ca-6ed95045095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Converting VIF {"id": "d711d258-7e53-4467-93ca-6ed95045095a", "address": "fa:16:3e:06:0d:dc", "network": {"id": "9397df5e-5494-42e9-b228-e6e56895fd13", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1555022831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9165dbae4d9448d6adba10e82cbfc624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd711d258-7e", "ovs_interfaceid": "d711d258-7e53-4467-93ca-6ed95045095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=d711d258-7e53-4467-93ca-6ed95045095a,network=Network(9397df5e-5494-42e9-b228-e6e56895fd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd711d258-7e') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG os_vif [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=d711d258-7e53-4467-93ca-6ed95045095a,network=Network(9397df5e-5494-42e9-b228-e6e56895fd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd711d258-7e') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84e37fda-16bf-58f6-ac36-5fcd0bcc90c7', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd711d258-7e, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd711d258-7e, col_values=(('qos', UUID('91e54c29-f364-4ce3-bbeb-b873468f6aa4')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd711d258-7e, col_values=(('external_ids', {'iface-id': 'd711d258-7e53-4467-93ca-6ed95045095a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:0d:dc', 'vm-uuid': '8c37887f-4c8a-4808-82a7-f8701dd9b62e'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:57:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:57:05 user nova-compute[74540]: INFO nova.compute.claims [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Claim successful on node user
Nov 07 03:57:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:05 user nova-compute[74540]: INFO os_vif [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=d711d258-7e53-4467-93ca-6ed95045095a,network=Network(9397df5e-5494-42e9-b228-e6e56895fd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd711d258-7e')
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] No BDM found with device name sda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] No VIF found with MAC fa:16:3e:06:0d:dc, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:57:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Using config drive
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.network.neutron [req-ad6dc91a-3b85-4a56-92f1-586de319b0d1 req-9884d9e7-6626-47b6-a9db-f1749ec54971 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Updated VIF entry in instance network info cache for port d711d258-7e53-4467-93ca-6ed95045095a. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.network.neutron [req-ad6dc91a-3b85-4a56-92f1-586de319b0d1 req-9884d9e7-6626-47b6-a9db-f1749ec54971 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Updating instance_info_cache with network_info: [{"id": "d711d258-7e53-4467-93ca-6ed95045095a", "address": "fa:16:3e:06:0d:dc", "network": {"id": "9397df5e-5494-42e9-b228-e6e56895fd13", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1555022831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9165dbae4d9448d6adba10e82cbfc624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd711d258-7e", "ovs_interfaceid": "d711d258-7e53-4467-93ca-6ed95045095a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ad6dc91a-3b85-4a56-92f1-586de319b0d1 req-9884d9e7-6626-47b6-a9db-f1749ec54971 service nova] Releasing lock "refresh_cache-8c37887f-4c8a-4808-82a7-f8701dd9b62e" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.750s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:57:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Creating config drive at /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk.config
Nov 07 03:57:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqqmhe55w {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqqmhe55w" returned: 0 in 0.081s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.network.neutron [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:57:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.policy [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c98fea902baa441d995919633f4dff8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740df87a8830417797c8126d81b36377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:57:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Creating image(s)
Nov 07 03:57:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "/opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "/opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.259s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.009s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.240s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk 1073741824" returned: 0 in 0.073s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.280s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:07 user nova-compute[74540]: DEBUG nova.network.neutron [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Successfully created port: 4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:57:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:08 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Cannot resize image /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 03:57:08 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 03:57:08 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Ensure instance console log exists: /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:57:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.network.neutron [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Successfully updated port: 4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "refresh_cache-5d248eae-ef06-4be3-9178-15d54309be59" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquired lock "refresh_cache-5d248eae-ef06-4be3-9178-15d54309be59" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.network.neutron [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-88e0bb52-7363-427f-823f-ad881e20a514 req-ff8b0663-c879-41df-9b32-8296ed8d51b5 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Received event network-changed-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-88e0bb52-7363-427f-823f-ad881e20a514 req-ff8b0663-c879-41df-9b32-8296ed8d51b5 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Refreshing instance network info cache due to event network-changed-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-88e0bb52-7363-427f-823f-ad881e20a514 req-ff8b0663-c879-41df-9b32-8296ed8d51b5 service nova] Acquiring lock "refresh_cache-5d248eae-ef06-4be3-9178-15d54309be59" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.network.neutron [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.network.neutron [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Updating instance_info_cache with network_info: [{"id": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "address": "fa:16:3e:d8:ff:dc", "network": {"id": "c05abc26-7a24-4c10-8a8a-dc373474d503", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1825825046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740df87a8830417797c8126d81b36377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbbc3b5-40", "ovs_interfaceid": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Releasing lock "refresh_cache-5d248eae-ef06-4be3-9178-15d54309be59" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.compute.manager [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Instance network_info: |[{"id": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "address": "fa:16:3e:d8:ff:dc", "network": {"id": "c05abc26-7a24-4c10-8a8a-dc373474d503", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1825825046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740df87a8830417797c8126d81b36377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbbc3b5-40", "ovs_interfaceid": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-88e0bb52-7363-427f-823f-ad881e20a514 req-ff8b0663-c879-41df-9b32-8296ed8d51b5 service nova] Acquired lock "refresh_cache-5d248eae-ef06-4be3-9178-15d54309be59" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.network.neutron [req-88e0bb52-7363-427f-823f-ad881e20a514 req-ff8b0663-c879-41df-9b32-8296ed8d51b5 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Refreshing network info cache for port 4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Start _get_guest_xml network_info=[{"id": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "address": "fa:16:3e:d8:ff:dc", "network": {"id": "c05abc26-7a24-4c10-8a8a-dc373474d503", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1825825046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740df87a8830417797c8126d81b36377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbbc3b5-40", "ovs_interfaceid": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:57:09 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:57:09 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1064235711',display_name='tempest-TestVolumeSwap-server-1064235711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1064235711',id=8,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8D1FR+XkoXDractWtnx2wh5nZ+gr4oimSrZ21X8Rsh9bskbNg/E+ofmIpXUY00nH4Z01viztRyneF2f4RL/W5gs3ieppnKouO7TJNtH0kORN2WBrE/jT8CRoms8C+XMQ==',key_name='tempest-keypair-160391377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740df87a8830417797c8126d81b36377',ramdisk_id='',reservation_id='r-l904x80m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1451835974',owner_user_name='tempest-TestVolumeSwap-1451835974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c98fea902baa441d995919633f4dff8d',uuid=5d248eae-ef06-4be3-9178-15d54309be59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "address": "fa:16:3e:d8:ff:dc", "network": {"id": "c05abc26-7a24-4c10-8a8a-dc373474d503", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1825825046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740df87a8830417797c8126d81b36377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbbc3b5-40", "ovs_interfaceid": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Converting VIF {"id": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "address": "fa:16:3e:d8:ff:dc", "network": {"id": "c05abc26-7a24-4c10-8a8a-dc373474d503", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1825825046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740df87a8830417797c8126d81b36377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbbc3b5-40", "ovs_interfaceid": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:ff:dc,bridge_name='br-int',has_traffic_filtering=True,id=4cbbc3b5-403c-4f1b-84d5-0b520e4eb835,network=Network(c05abc26-7a24-4c10-8a8a-dc373474d503),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbbc3b5-40') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.objects.instance [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d248eae-ef06-4be3-9178-15d54309be59 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:57:09 user nova-compute[74540]:   <uuid>5d248eae-ef06-4be3-9178-15d54309be59</uuid>
Nov 07 03:57:09 user nova-compute[74540]:   <name>instance-00000008</name>
Nov 07 03:57:09 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:57:09 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:57:09 user nova-compute[74540]:   <metadata>
Nov 07 03:57:09 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:57:09 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:57:09 user nova-compute[74540]:       <nova:name>tempest-TestVolumeSwap-server-1064235711</nova:name>
Nov 07 03:57:09 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:57:09</nova:creationTime>
Nov 07 03:57:09 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:57:09 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:57:09 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:57:09 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:57:09 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:57:09 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:57:09 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:57:09 user nova-compute[74540]:       <nova:owner>
Nov 07 03:57:09 user nova-compute[74540]:         <nova:user uuid="c98fea902baa441d995919633f4dff8d">tempest-TestVolumeSwap-1451835974-project-member</nova:user>
Nov 07 03:57:09 user nova-compute[74540]:         <nova:project uuid="740df87a8830417797c8126d81b36377">tempest-TestVolumeSwap-1451835974</nova:project>
Nov 07 03:57:09 user nova-compute[74540]:       </nova:owner>
Nov 07 03:57:09 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 03:57:09 user nova-compute[74540]:       <nova:ports>
Nov 07 03:57:09 user nova-compute[74540]:         <nova:port uuid="4cbbc3b5-403c-4f1b-84d5-0b520e4eb835">
Nov 07 03:57:09 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 03:57:09 user nova-compute[74540]:         </nova:port>
Nov 07 03:57:09 user nova-compute[74540]:       </nova:ports>
Nov 07 03:57:09 user nova-compute[74540]:     </nova:instance>
Nov 07 03:57:09 user nova-compute[74540]:   </metadata>
Nov 07 03:57:09 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:57:09 user nova-compute[74540]:     <system>
Nov 07 03:57:09 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:57:09 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:57:09 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:57:09 user nova-compute[74540]:       <entry name="serial">5d248eae-ef06-4be3-9178-15d54309be59</entry>
Nov 07 03:57:09 user nova-compute[74540]:       <entry name="uuid">5d248eae-ef06-4be3-9178-15d54309be59</entry>
Nov 07 03:57:09 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:57:09 user nova-compute[74540]:     </system>
Nov 07 03:57:09 user nova-compute[74540]:   </sysinfo>
Nov 07 03:57:09 user nova-compute[74540]:   <os>
Nov 07 03:57:09 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:57:09 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 03:57:09 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:57:09 user nova-compute[74540]:   </os>
Nov 07 03:57:09 user nova-compute[74540]:   <features>
Nov 07 03:57:09 user nova-compute[74540]:     <acpi/>
Nov 07 03:57:09 user nova-compute[74540]:     <apic/>
Nov 07 03:57:09 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:57:09 user nova-compute[74540]:   </features>
Nov 07 03:57:09 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:57:09 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:57:09 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:57:09 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:57:09 user nova-compute[74540]:   </clock>
Nov 07 03:57:09 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:57:09 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:57:09 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:57:09 user nova-compute[74540]:   </cpu>
Nov 07 03:57:09 user nova-compute[74540]:   <devices>
Nov 07 03:57:09 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 03:57:09 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 03:57:09 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk"/>
Nov 07 03:57:09 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 03:57:09 user nova-compute[74540]:     </disk>
Nov 07 03:57:09 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:57:09 user nova-compute[74540]:       <mac address="fa:16:3e:d8:ff:dc"/>
Nov 07 03:57:09 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:57:09 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:57:09 user nova-compute[74540]:       <target dev="tap4cbbc3b5-40"/>
Nov 07 03:57:09 user nova-compute[74540]:     </interface>
Nov 07 03:57:09 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:57:09 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/console.log" append="off"/>
Nov 07 03:57:09 user nova-compute[74540]:     </serial>
Nov 07 03:57:09 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:57:09 user nova-compute[74540]:     <video>
Nov 07 03:57:09 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:57:09 user nova-compute[74540]:     </video>
Nov 07 03:57:09 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:57:09 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:57:09 user nova-compute[74540]:     </rng>
Nov 07 03:57:09 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:57:09 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:57:09 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:57:09 user nova-compute[74540]:     </memballoon>
Nov 07 03:57:09 user nova-compute[74540]:   </devices>
Nov 07 03:57:09 user nova-compute[74540]: </domain>
Nov 07 03:57:09 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1064235711',display_name='tempest-TestVolumeSwap-server-1064235711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1064235711',id=8,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8D1FR+XkoXDractWtnx2wh5nZ+gr4oimSrZ21X8Rsh9bskbNg/E+ofmIpXUY00nH4Z01viztRyneF2f4RL/W5gs3ieppnKouO7TJNtH0kORN2WBrE/jT8CRoms8C+XMQ==',key_name='tempest-keypair-160391377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='740df87a8830417797c8126d81b36377',ramdisk_id='',reservation_id='r-l904x80m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1451835974',owner_user_name='tempest-TestVolumeSwap-1451835974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c98fea902baa441d995919633f4dff8d',uuid=5d248eae-ef06-4be3-9178-15d54309be59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "address": "fa:16:3e:d8:ff:dc", "network": {"id": "c05abc26-7a24-4c10-8a8a-dc373474d503", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1825825046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740df87a8830417797c8126d81b36377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbbc3b5-40", "ovs_interfaceid": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Converting VIF {"id": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "address": "fa:16:3e:d8:ff:dc", "network": {"id": "c05abc26-7a24-4c10-8a8a-dc373474d503", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1825825046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740df87a8830417797c8126d81b36377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbbc3b5-40", "ovs_interfaceid": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:ff:dc,bridge_name='br-int',has_traffic_filtering=True,id=4cbbc3b5-403c-4f1b-84d5-0b520e4eb835,network=Network(c05abc26-7a24-4c10-8a8a-dc373474d503),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbbc3b5-40') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG os_vif [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:ff:dc,bridge_name='br-int',has_traffic_filtering=True,id=4cbbc3b5-403c-4f1b-84d5-0b520e4eb835,network=Network(c05abc26-7a24-4c10-8a8a-dc373474d503),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbbc3b5-40') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56da9ac6-26aa-5594-bd29-5c1a3d0bc4a9', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cbbc3b5-40, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cbbc3b5-40, col_values=(('qos', UUID('8f737675-aa15-429f-9817-d0c5390e907f')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cbbc3b5-40, col_values=(('external_ids', {'iface-id': '4cbbc3b5-403c-4f1b-84d5-0b520e4eb835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:ff:dc', 'vm-uuid': '5d248eae-ef06-4be3-9178-15d54309be59'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:09 user nova-compute[74540]: INFO os_vif [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:ff:dc,bridge_name='br-int',has_traffic_filtering=True,id=4cbbc3b5-403c-4f1b-84d5-0b520e4eb835,network=Network(c05abc26-7a24-4c10-8a8a-dc373474d503),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbbc3b5-40')
Nov 07 03:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:57:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] No VIF found with MAC fa:16:3e:d8:ff:dc, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:57:10 user nova-compute[74540]: DEBUG nova.network.neutron [req-88e0bb52-7363-427f-823f-ad881e20a514 req-ff8b0663-c879-41df-9b32-8296ed8d51b5 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Updated VIF entry in instance network info cache for port 4cbbc3b5-403c-4f1b-84d5-0b520e4eb835. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:57:10 user nova-compute[74540]: DEBUG nova.network.neutron [req-88e0bb52-7363-427f-823f-ad881e20a514 req-ff8b0663-c879-41df-9b32-8296ed8d51b5 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Updating instance_info_cache with network_info: [{"id": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "address": "fa:16:3e:d8:ff:dc", "network": {"id": "c05abc26-7a24-4c10-8a8a-dc373474d503", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1825825046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740df87a8830417797c8126d81b36377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbbc3b5-40", "ovs_interfaceid": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:57:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-88e0bb52-7363-427f-823f-ad881e20a514 req-ff8b0663-c879-41df-9b32-8296ed8d51b5 service nova] Releasing lock "refresh_cache-5d248eae-ef06-4be3-9178-15d54309be59" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:57:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 03:57:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 03:57:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:11 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Instance spawned successfully.
Nov 07 03:57:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 03:57:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:11 user nova-compute[74540]: INFO nova.compute.manager [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Took 8.51 seconds to spawn the instance on the hypervisor.
Nov 07 03:57:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:57:11 user nova-compute[74540]: INFO nova.compute.manager [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Took 9.92 seconds to build instance.
Nov 07 03:57:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01bb7c45-3fc1-44b0-b50b-825784948be6 tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.133s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 03:57:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 03:57:13 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Instance spawned successfully.
Nov 07 03:57:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 03:57:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:13 user nova-compute[74540]: INFO nova.compute.manager [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 07 03:57:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:57:13 user nova-compute[74540]: INFO nova.compute.manager [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Took 8.21 seconds to build instance.
Nov 07 03:57:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-822bc2b0-2edb-4815-a5fa-7b77824f2d7a tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "5d248eae-ef06-4be3-9178-15d54309be59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.413s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-a57cc992-702f-43db-9433-72353a2bc8f5 req-d569efed-dcfa-4d47-bef9-ca210ebaf5c7 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received event network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a57cc992-702f-43db-9433-72353a2bc8f5 req-d569efed-dcfa-4d47-bef9-ca210ebaf5c7 service nova] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a57cc992-702f-43db-9433-72353a2bc8f5 req-d569efed-dcfa-4d47-bef9-ca210ebaf5c7 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a57cc992-702f-43db-9433-72353a2bc8f5 req-d569efed-dcfa-4d47-bef9-ca210ebaf5c7 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-a57cc992-702f-43db-9433-72353a2bc8f5 req-d569efed-dcfa-4d47-bef9-ca210ebaf5c7 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] No waiting events found dispatching network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:15 user nova-compute[74540]: WARNING nova.compute.manager [req-a57cc992-702f-43db-9433-72353a2bc8f5 req-d569efed-dcfa-4d47-bef9-ca210ebaf5c7 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received unexpected event network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 for instance with vm_state active and task_state None.
Nov 07 03:57:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Acquiring lock "a78e9806-c043-437c-b085-108eee9a921b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "a78e9806-c043-437c-b085-108eee9a921b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:57:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:57:16 user nova-compute[74540]: INFO nova.compute.claims [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Claim successful on node user
Nov 07 03:57:16 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:57:16 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:57:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:57:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:57:16 user nova-compute[74540]: DEBUG nova.network.neutron [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:57:16 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 03:57:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:57:16 user nova-compute[74540]: DEBUG nova.policy [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f1009e1abac41879d5560ca577f71cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f8f90448fc46938fcbd7edd12a33f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:57:17 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Creating image(s)
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Acquiring lock "/opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "/opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "/opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.217s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.278s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk 1073741824" returned: 0 in 0.066s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG nova.network.neutron [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Successfully created port: 88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-7b31e6c7-1d8e-40a8-b2e9-f143e46985f9 req-3efe1587-3e03-42d5-926a-595ce5e6389c service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received event network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7b31e6c7-1d8e-40a8-b2e9-f143e46985f9 req-3efe1587-3e03-42d5-926a-595ce5e6389c service nova] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7b31e6c7-1d8e-40a8-b2e9-f143e46985f9 req-3efe1587-3e03-42d5-926a-595ce5e6389c service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7b31e6c7-1d8e-40a8-b2e9-f143e46985f9 req-3efe1587-3e03-42d5-926a-595ce5e6389c service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-7b31e6c7-1d8e-40a8-b2e9-f143e46985f9 req-3efe1587-3e03-42d5-926a-595ce5e6389c service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] No waiting events found dispatching network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:17 user nova-compute[74540]: WARNING nova.compute.manager [req-7b31e6c7-1d8e-40a8-b2e9-f143e46985f9 req-3efe1587-3e03-42d5-926a-595ce5e6389c service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received unexpected event network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 for instance with vm_state active and task_state None.
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.259s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 03:57:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Cannot resize image /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Ensure instance console log exists: /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Successfully updated port: 88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Acquiring lock "refresh_cache-a78e9806-c043-437c-b085-108eee9a921b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Acquired lock "refresh_cache-a78e9806-c043-437c-b085-108eee9a921b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-e8832e2c-0631-4ce3-99a3-237cb342c38a req-2a2de096-f5e4-4c90-ac10-f6d86e4859dd service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Received event network-changed-88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-e8832e2c-0631-4ce3-99a3-237cb342c38a req-2a2de096-f5e4-4c90-ac10-f6d86e4859dd service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Refreshing instance network info cache due to event network-changed-88b714c9-dbce-4852-b4db-914aabf9b148. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e8832e2c-0631-4ce3-99a3-237cb342c38a req-2a2de096-f5e4-4c90-ac10-f6d86e4859dd service nova] Acquiring lock "refresh_cache-a78e9806-c043-437c-b085-108eee9a921b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Updating instance_info_cache with network_info: [{"id": "88b714c9-dbce-4852-b4db-914aabf9b148", "address": "fa:16:3e:4a:39:9d", "network": {"id": "6476c0b5-57f3-4884-b30b-14a860ab605e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1311869783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f8f90448fc46938fcbd7edd12a33f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b714c9-db", "ovs_interfaceid": "88b714c9-dbce-4852-b4db-914aabf9b148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Releasing lock "refresh_cache-a78e9806-c043-437c-b085-108eee9a921b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.compute.manager [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Instance network_info: |[{"id": "88b714c9-dbce-4852-b4db-914aabf9b148", "address": "fa:16:3e:4a:39:9d", "network": {"id": "6476c0b5-57f3-4884-b30b-14a860ab605e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1311869783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f8f90448fc46938fcbd7edd12a33f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b714c9-db", "ovs_interfaceid": "88b714c9-dbce-4852-b4db-914aabf9b148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e8832e2c-0631-4ce3-99a3-237cb342c38a req-2a2de096-f5e4-4c90-ac10-f6d86e4859dd service nova] Acquired lock "refresh_cache-a78e9806-c043-437c-b085-108eee9a921b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-e8832e2c-0631-4ce3-99a3-237cb342c38a req-2a2de096-f5e4-4c90-ac10-f6d86e4859dd service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Refreshing network info cache for port 88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Start _get_guest_xml network_info=[{"id": "88b714c9-dbce-4852-b4db-914aabf9b148", "address": "fa:16:3e:4a:39:9d", "network": {"id": "6476c0b5-57f3-4884-b30b-14a860ab605e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1311869783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f8f90448fc46938fcbd7edd12a33f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b714c9-db", "ovs_interfaceid": "88b714c9-dbce-4852-b4db-914aabf9b148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:57:18 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:57:18 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-851480173',display_name='tempest-VolumesAssistedSnapshotsTest-server-851480173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-851480173',id=9,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpxrT9EAjhtY+XmZw3o43nhsipsxl87jFcZH7M3kAF1sOydZaPP99IOmn7Z6KpoyXK7gLdnCOQISHSZuMlV2njjuMwFVfg4Ds+3EcbWovoO/jY7+RMY3PCLNRZBsfpodQ==',key_name='tempest-keypair-2069609325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90f8f90448fc46938fcbd7edd12a33f8',ramdisk_id='',reservation_id='r-46jja8vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-778897619',owner_user_name='tempest-VolumesAssistedSnapshotsTest-778897619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:57:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f1009e1abac41879d5560ca577f71cb',uuid=a78e9806-c043-437c-b085-108eee9a921b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88b714c9-dbce-4852-b4db-914aabf9b148", "address": "fa:16:3e:4a:39:9d", "network": {"id": "6476c0b5-57f3-4884-b30b-14a860ab605e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1311869783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f8f90448fc46938fcbd7edd12a33f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b714c9-db", "ovs_interfaceid": "88b714c9-dbce-4852-b4db-914aabf9b148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Converting VIF {"id": "88b714c9-dbce-4852-b4db-914aabf9b148", "address": "fa:16:3e:4a:39:9d", "network": {"id": "6476c0b5-57f3-4884-b30b-14a860ab605e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1311869783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f8f90448fc46938fcbd7edd12a33f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b714c9-db", "ovs_interfaceid": "88b714c9-dbce-4852-b4db-914aabf9b148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:39:9d,bridge_name='br-int',has_traffic_filtering=True,id=88b714c9-dbce-4852-b4db-914aabf9b148,network=Network(6476c0b5-57f3-4884-b30b-14a860ab605e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b714c9-db') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.objects.instance [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lazy-loading 'pci_devices' on Instance uuid a78e9806-c043-437c-b085-108eee9a921b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:57:18 user nova-compute[74540]:   <uuid>a78e9806-c043-437c-b085-108eee9a921b</uuid>
Nov 07 03:57:18 user nova-compute[74540]:   <name>instance-00000009</name>
Nov 07 03:57:18 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:57:18 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:57:18 user nova-compute[74540]:   <metadata>
Nov 07 03:57:18 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:57:18 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:57:18 user nova-compute[74540]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-851480173</nova:name>
Nov 07 03:57:18 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:57:18</nova:creationTime>
Nov 07 03:57:18 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:57:18 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:57:18 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:57:18 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:57:18 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:57:18 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:57:18 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:57:18 user nova-compute[74540]:       <nova:owner>
Nov 07 03:57:18 user nova-compute[74540]:         <nova:user uuid="8f1009e1abac41879d5560ca577f71cb">tempest-VolumesAssistedSnapshotsTest-778897619-project-member</nova:user>
Nov 07 03:57:18 user nova-compute[74540]:         <nova:project uuid="90f8f90448fc46938fcbd7edd12a33f8">tempest-VolumesAssistedSnapshotsTest-778897619</nova:project>
Nov 07 03:57:18 user nova-compute[74540]:       </nova:owner>
Nov 07 03:57:18 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 03:57:18 user nova-compute[74540]:       <nova:ports>
Nov 07 03:57:18 user nova-compute[74540]:         <nova:port uuid="88b714c9-dbce-4852-b4db-914aabf9b148">
Nov 07 03:57:18 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 03:57:18 user nova-compute[74540]:         </nova:port>
Nov 07 03:57:18 user nova-compute[74540]:       </nova:ports>
Nov 07 03:57:18 user nova-compute[74540]:     </nova:instance>
Nov 07 03:57:18 user nova-compute[74540]:   </metadata>
Nov 07 03:57:18 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:57:18 user nova-compute[74540]:     <system>
Nov 07 03:57:18 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:57:18 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:57:18 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:57:18 user nova-compute[74540]:       <entry name="serial">a78e9806-c043-437c-b085-108eee9a921b</entry>
Nov 07 03:57:18 user nova-compute[74540]:       <entry name="uuid">a78e9806-c043-437c-b085-108eee9a921b</entry>
Nov 07 03:57:18 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:57:18 user nova-compute[74540]:     </system>
Nov 07 03:57:18 user nova-compute[74540]:   </sysinfo>
Nov 07 03:57:18 user nova-compute[74540]:   <os>
Nov 07 03:57:18 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:57:18 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 03:57:18 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:57:18 user nova-compute[74540]:   </os>
Nov 07 03:57:18 user nova-compute[74540]:   <features>
Nov 07 03:57:18 user nova-compute[74540]:     <acpi/>
Nov 07 03:57:18 user nova-compute[74540]:     <apic/>
Nov 07 03:57:18 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:57:18 user nova-compute[74540]:   </features>
Nov 07 03:57:18 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:57:18 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:57:18 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:57:18 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:57:18 user nova-compute[74540]:   </clock>
Nov 07 03:57:18 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:57:18 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:57:18 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:57:18 user nova-compute[74540]:   </cpu>
Nov 07 03:57:18 user nova-compute[74540]:   <devices>
Nov 07 03:57:18 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 03:57:18 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 03:57:18 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk"/>
Nov 07 03:57:18 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 03:57:18 user nova-compute[74540]:     </disk>
Nov 07 03:57:18 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:57:18 user nova-compute[74540]:       <mac address="fa:16:3e:4a:39:9d"/>
Nov 07 03:57:18 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:57:18 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:57:18 user nova-compute[74540]:       <target dev="tap88b714c9-db"/>
Nov 07 03:57:18 user nova-compute[74540]:     </interface>
Nov 07 03:57:18 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:57:18 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/console.log" append="off"/>
Nov 07 03:57:18 user nova-compute[74540]:     </serial>
Nov 07 03:57:18 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:57:18 user nova-compute[74540]:     <video>
Nov 07 03:57:18 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:57:18 user nova-compute[74540]:     </video>
Nov 07 03:57:18 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:57:18 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:57:18 user nova-compute[74540]:     </rng>
Nov 07 03:57:18 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:57:18 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:57:18 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:57:18 user nova-compute[74540]:     </memballoon>
Nov 07 03:57:18 user nova-compute[74540]:   </devices>
Nov 07 03:57:18 user nova-compute[74540]: </domain>
Nov 07 03:57:18 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-851480173',display_name='tempest-VolumesAssistedSnapshotsTest-server-851480173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-851480173',id=9,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpxrT9EAjhtY+XmZw3o43nhsipsxl87jFcZH7M3kAF1sOydZaPP99IOmn7Z6KpoyXK7gLdnCOQISHSZuMlV2njjuMwFVfg4Ds+3EcbWovoO/jY7+RMY3PCLNRZBsfpodQ==',key_name='tempest-keypair-2069609325',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90f8f90448fc46938fcbd7edd12a33f8',ramdisk_id='',reservation_id='r-46jja8vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-778897619',owner_user_name='tempest-VolumesAssistedSnapshotsTest-778897619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:57:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f1009e1abac41879d5560ca577f71cb',uuid=a78e9806-c043-437c-b085-108eee9a921b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88b714c9-dbce-4852-b4db-914aabf9b148", "address": "fa:16:3e:4a:39:9d", "network": {"id": "6476c0b5-57f3-4884-b30b-14a860ab605e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1311869783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f8f90448fc46938fcbd7edd12a33f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b714c9-db", "ovs_interfaceid": "88b714c9-dbce-4852-b4db-914aabf9b148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Converting VIF {"id": "88b714c9-dbce-4852-b4db-914aabf9b148", "address": "fa:16:3e:4a:39:9d", "network": {"id": "6476c0b5-57f3-4884-b30b-14a860ab605e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1311869783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f8f90448fc46938fcbd7edd12a33f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b714c9-db", "ovs_interfaceid": "88b714c9-dbce-4852-b4db-914aabf9b148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:39:9d,bridge_name='br-int',has_traffic_filtering=True,id=88b714c9-dbce-4852-b4db-914aabf9b148,network=Network(6476c0b5-57f3-4884-b30b-14a860ab605e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b714c9-db') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG os_vif [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:39:9d,bridge_name='br-int',has_traffic_filtering=True,id=88b714c9-dbce-4852-b4db-914aabf9b148,network=Network(6476c0b5-57f3-4884-b30b-14a860ab605e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b714c9-db') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39b6a55c-89e8-5b98-b358-79c8688963ca', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88b714c9-db, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88b714c9-db, col_values=(('qos', UUID('b652b792-c858-4fba-846d-1680186b4ee7')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88b714c9-db, col_values=(('external_ids', {'iface-id': '88b714c9-dbce-4852-b4db-914aabf9b148', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:39:9d', 'vm-uuid': 'a78e9806-c043-437c-b085-108eee9a921b'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:18 user nova-compute[74540]: INFO os_vif [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:39:9d,bridge_name='br-int',has_traffic_filtering=True,id=88b714c9-dbce-4852-b4db-914aabf9b148,network=Network(6476c0b5-57f3-4884-b30b-14a860ab605e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b714c9-db')
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:57:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] No VIF found with MAC fa:16:3e:4a:39:9d, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:57:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-e8832e2c-0631-4ce3-99a3-237cb342c38a req-2a2de096-f5e4-4c90-ac10-f6d86e4859dd service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Updated VIF entry in instance network info cache for port 88b714c9-dbce-4852-b4db-914aabf9b148. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:57:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-e8832e2c-0631-4ce3-99a3-237cb342c38a req-2a2de096-f5e4-4c90-ac10-f6d86e4859dd service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Updating instance_info_cache with network_info: [{"id": "88b714c9-dbce-4852-b4db-914aabf9b148", "address": "fa:16:3e:4a:39:9d", "network": {"id": "6476c0b5-57f3-4884-b30b-14a860ab605e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1311869783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f8f90448fc46938fcbd7edd12a33f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b714c9-db", "ovs_interfaceid": "88b714c9-dbce-4852-b4db-914aabf9b148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:57:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e8832e2c-0631-4ce3-99a3-237cb342c38a req-2a2de096-f5e4-4c90-ac10-f6d86e4859dd service nova] Releasing lock "refresh_cache-a78e9806-c043-437c-b085-108eee9a921b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:57:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:20 user nova-compute[74540]: DEBUG nova.compute.manager [req-5862379b-b690-4196-9287-55fd135d34f1 req-403c62b5-1f56-411a-aa10-031b006ff83a service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Received event network-vif-plugged-88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5862379b-b690-4196-9287-55fd135d34f1 req-403c62b5-1f56-411a-aa10-031b006ff83a service nova] Acquiring lock "a78e9806-c043-437c-b085-108eee9a921b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5862379b-b690-4196-9287-55fd135d34f1 req-403c62b5-1f56-411a-aa10-031b006ff83a service nova] Lock "a78e9806-c043-437c-b085-108eee9a921b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5862379b-b690-4196-9287-55fd135d34f1 req-403c62b5-1f56-411a-aa10-031b006ff83a service nova] Lock "a78e9806-c043-437c-b085-108eee9a921b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:20 user nova-compute[74540]: DEBUG nova.compute.manager [req-5862379b-b690-4196-9287-55fd135d34f1 req-403c62b5-1f56-411a-aa10-031b006ff83a service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] No waiting events found dispatching network-vif-plugged-88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:20 user nova-compute[74540]: WARNING nova.compute.manager [req-5862379b-b690-4196-9287-55fd135d34f1 req-403c62b5-1f56-411a-aa10-031b006ff83a service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Received unexpected event network-vif-plugged-88b714c9-dbce-4852-b4db-914aabf9b148 for instance with vm_state building and task_state spawning.
Nov 07 03:57:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-4ea746f1-93b1-4b2b-8f03-62a6642b19a8 req-b2fab3d6-4eb3-49b5-9c8b-6ac313d4d9ac service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Received event network-vif-plugged-88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4ea746f1-93b1-4b2b-8f03-62a6642b19a8 req-b2fab3d6-4eb3-49b5-9c8b-6ac313d4d9ac service nova] Acquiring lock "a78e9806-c043-437c-b085-108eee9a921b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4ea746f1-93b1-4b2b-8f03-62a6642b19a8 req-b2fab3d6-4eb3-49b5-9c8b-6ac313d4d9ac service nova] Lock "a78e9806-c043-437c-b085-108eee9a921b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4ea746f1-93b1-4b2b-8f03-62a6642b19a8 req-b2fab3d6-4eb3-49b5-9c8b-6ac313d4d9ac service nova] Lock "a78e9806-c043-437c-b085-108eee9a921b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-4ea746f1-93b1-4b2b-8f03-62a6642b19a8 req-b2fab3d6-4eb3-49b5-9c8b-6ac313d4d9ac service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] No waiting events found dispatching network-vif-plugged-88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:22 user nova-compute[74540]: WARNING nova.compute.manager [req-4ea746f1-93b1-4b2b-8f03-62a6642b19a8 req-b2fab3d6-4eb3-49b5-9c8b-6ac313d4d9ac service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Received unexpected event network-vif-plugged-88b714c9-dbce-4852-b4db-914aabf9b148 for instance with vm_state building and task_state spawning.
Nov 07 03:57:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] There are 0 instances to clean {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74540) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 03:57:22 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: a78e9806-c043-437c-b085-108eee9a921b] Instance spawned successfully.
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:57:23 user nova-compute[74540]: INFO nova.compute.manager [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 07 03:57:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:57:23 user nova-compute[74540]: INFO nova.compute.manager [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Took 7.14 seconds to build instance.
Nov 07 03:57:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-096237ea-990d-4fed-87a1-8d1bbd3e2fb3 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "a78e9806-c043-437c-b085-108eee9a921b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.310s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:57:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:57:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:26 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:57:26 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 03:57:26 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 03:57:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:57:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:57:26 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 03:57:26 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:57:27 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updating instance_info_cache with network_info: [{"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:57:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:57:27 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 03:57:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:57:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:57:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:57:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:57:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:57:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-6c8c5e6a-65d8-4f8d-b865-74ba6e5c2d26 req-46825082-9af8-41b2-8797-92ba6787d07c service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6c8c5e6a-65d8-4f8d-b865-74ba6e5c2d26 req-46825082-9af8-41b2-8797-92ba6787d07c service nova] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6c8c5e6a-65d8-4f8d-b865-74ba6e5c2d26 req-46825082-9af8-41b2-8797-92ba6787d07c service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6c8c5e6a-65d8-4f8d-b865-74ba6e5c2d26 req-46825082-9af8-41b2-8797-92ba6787d07c service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-6c8c5e6a-65d8-4f8d-b865-74ba6e5c2d26 req-46825082-9af8-41b2-8797-92ba6787d07c service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] No waiting events found dispatching network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:28 user nova-compute[74540]: WARNING nova.compute.manager [req-6c8c5e6a-65d8-4f8d-b865-74ba6e5c2d26 req-46825082-9af8-41b2-8797-92ba6787d07c service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received unexpected event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec for instance with vm_state active and task_state None.
Nov 07 03:57:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] No waiting events found dispatching network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:30 user nova-compute[74540]: WARNING nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received unexpected event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec for instance with vm_state active and task_state None.
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received event network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] No waiting events found dispatching network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:30 user nova-compute[74540]: WARNING nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received unexpected event network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c for instance with vm_state active and task_state None.
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received event network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] No waiting events found dispatching network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:30 user nova-compute[74540]: WARNING nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received unexpected event network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c for instance with vm_state active and task_state None.
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Received event network-vif-plugged-d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Acquiring lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] No waiting events found dispatching network-vif-plugged-d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:30 user nova-compute[74540]: WARNING nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Received unexpected event network-vif-plugged-d711d258-7e53-4467-93ca-6ed95045095a for instance with vm_state active and task_state None.
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Received event network-vif-plugged-d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Acquiring lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] No waiting events found dispatching network-vif-plugged-d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:30 user nova-compute[74540]: WARNING nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Received unexpected event network-vif-plugged-d711d258-7e53-4467-93ca-6ed95045095a for instance with vm_state active and task_state None.
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Received event network-vif-plugged-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Acquiring lock "5d248eae-ef06-4be3-9178-15d54309be59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "5d248eae-ef06-4be3-9178-15d54309be59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "5d248eae-ef06-4be3-9178-15d54309be59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] No waiting events found dispatching network-vif-plugged-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:30 user nova-compute[74540]: WARNING nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Received unexpected event network-vif-plugged-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 for instance with vm_state active and task_state None.
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Received event network-vif-plugged-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Acquiring lock "5d248eae-ef06-4be3-9178-15d54309be59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "5d248eae-ef06-4be3-9178-15d54309be59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] Lock "5d248eae-ef06-4be3-9178-15d54309be59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] No waiting events found dispatching network-vif-plugged-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:57:30 user nova-compute[74540]: WARNING nova.compute.manager [req-b6118731-aeb3-4a6e-a978-8a4bfd87a96a req-e2284598-2c87-4ba8-9c7e-4d2189c74bf6 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Received unexpected event network-vif-plugged-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 for instance with vm_state active and task_state None.
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:32 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:57:32 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7324MB free_disk=25.390933990478516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a3cae7a7-223c-438e-8206-39e0f1683cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d6501f90-9180-4e99-a294-9ffba799c247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6d43f26f-dfbb-4299-b875-f498979679d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 8c37887f-4c8a-4808-82a7-f8701dd9b62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d248eae-ef06-4be3-9178-15d54309be59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a78e9806-c043-437c-b085-108eee9a921b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing inventories for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating ProviderTree inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing aggregate associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, aggregates: None {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing trait associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 03:57:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.855s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:33 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:57:33 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 03:57:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "fab159b1-8768-4266-9a2f-3983628aeb86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "fab159b1-8768-4266-9a2f-3983628aeb86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:48 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:57:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:57:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:57:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:57:48 user nova-compute[74540]: INFO nova.compute.claims [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Claim successful on node user
Nov 07 03:57:48 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:57:48 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:57:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:57:48 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:57:48 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:57:48 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:57:48 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 03:57:48 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:57:48 user nova-compute[74540]: INFO nova.virt.block_device [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Booting with volume 9edaab1d-3869-4da4-81e8-39c0bd9687a1 at /dev/vda
Nov 07 03:57:48 user nova-compute[74540]: DEBUG nova.policy [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3aebf4eecd5445e3a118203654ae2dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1ae9772ccb4183b607084edfb8c314', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:57:48 user nova-compute[74540]: DEBUG os_brick.utils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:57:48 user nova-compute[74540]: INFO oslo.privsep.daemon [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpv5n8ij0u/privsep.sock']
Nov 07 03:57:48 user sudo[85862]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpv5n8ij0u/privsep.sock
Nov 07 03:57:48 user sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 07 03:57:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:49 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Successfully created port: 8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:57:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Successfully updated port: 8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "refresh_cache-fab159b1-8768-4266-9a2f-3983628aeb86" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquired lock "refresh_cache-fab159b1-8768-4266-9a2f-3983628aeb86" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-c9e46b00-fc01-4411-b60e-114d8410b6ba req-80221012-93d6-46cb-a508-7ca149dd5668 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Received event network-changed-8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-c9e46b00-fc01-4411-b60e-114d8410b6ba req-80221012-93d6-46cb-a508-7ca149dd5668 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Refreshing instance network info cache due to event network-changed-8689cc10-30f0-488d-abae-c8edc08c9750. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c9e46b00-fc01-4411-b60e-114d8410b6ba req-80221012-93d6-46cb-a508-7ca149dd5668 service nova] Acquiring lock "refresh_cache-fab159b1-8768-4266-9a2f-3983628aeb86" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:57:50 user sudo[85862]: pam_unix(sudo:session): session closed for user root
Nov 07 03:57:50 user nova-compute[74540]: INFO oslo.privsep.daemon [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Spawned new privsep daemon via rootwrap
Nov 07 03:57:50 user nova-compute[74540]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 07 03:57:50 user nova-compute[74540]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 07 03:57:50 user nova-compute[74540]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 07 03:57:50 user nova-compute[74540]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85868
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd18b0a-25a5-4a79-b56b-8bfbbe7c73f0]: (2,) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Updating instance_info_cache with network_info: [{"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Releasing lock "refresh_cache-fab159b1-8768-4266-9a2f-3983628aeb86" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Instance network_info: |[{"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c9e46b00-fc01-4411-b60e-114d8410b6ba req-80221012-93d6-46cb-a508-7ca149dd5668 service nova] Acquired lock "refresh_cache-fab159b1-8768-4266-9a2f-3983628aeb86" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG nova.network.neutron [req-c9e46b00-fc01-4411-b60e-114d8410b6ba req-80221012-93d6-46cb-a508-7ca149dd5668 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Refreshing network info cache for port 8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[24602c65-88fa-44fd-b43d-1beb6d0e15fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:57:50 user nova-compute[74540]: WARNING os_brick.initiator.connectors.nvmeof [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1649a9c2-8929-4919-98e1-5d87336c4680]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b749af0-df4d-404d-9844-7e113f5934bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdd0f98-b339-4ca9-97ab-221085df57f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:57:50 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6544b27e-8497-417e-8335-2508dd47e448]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG os_brick.utils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] <== get_connector_properties: return (1913ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Updating existing volume attachment record: 0814fc2a-7beb-41ee-a8bf-4c972100b6e4 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG nova.network.neutron [req-c9e46b00-fc01-4411-b60e-114d8410b6ba req-80221012-93d6-46cb-a508-7ca149dd5668 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Updated VIF entry in instance network info cache for port 8689cc10-30f0-488d-abae-c8edc08c9750. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG nova.network.neutron [req-c9e46b00-fc01-4411-b60e-114d8410b6ba req-80221012-93d6-46cb-a508-7ca149dd5668 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Updating instance_info_cache with network_info: [{"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:57:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c9e46b00-fc01-4411-b60e-114d8410b6ba req-80221012-93d6-46cb-a508-7ca149dd5668 service nova] Releasing lock "refresh_cache-fab159b1-8768-4266-9a2f-3983628aeb86" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:57:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:57:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:58:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 03:58:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 03:58:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 03:58:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:58:11 user nova-compute[74540]: INFO nova.compute.claims [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Claim successful on node user
Nov 07 03:58:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.368s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:58:11 user nova-compute[74540]: INFO nova.compute.claims [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Claim successful on node user
Nov 07 03:58:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:58:11 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:58:11 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 03:58:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:58:11 user nova-compute[74540]: INFO nova.virt.block_device [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Booting with volume 5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 at /dev/vda
Nov 07 03:58:11 user nova-compute[74540]: DEBUG nova.policy [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8307342a3838409c842e44cdea7d9e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663e196e8d464d188e5e5dfbf8965da7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG os_brick.utils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9733a6b-a9a0-498d-8480-37ce25da165a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb0ca06-87b5-4b87-beb2-9ef7b85ca293]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bec229-a000-4a29-940b-895acc39a0fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[500e396c-fc6d-447a-b95a-65d31677a8c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:58:12 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[63591883-ab91-4f10-b4c6-5691cb0f9700]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG os_brick.utils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating existing volume attachment record: f6560972-b29a-4207-83a8-27e6d32671ad {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:58:12 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 03:58:12 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:58:12 user nova-compute[74540]: INFO nova.virt.block_device [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Booting with volume fb37dc02-088b-464c-a566-e78213216c60 at /dev/vda
Nov 07 03:58:12 user nova-compute[74540]: DEBUG nova.policy [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd27d820855314e489ea12aba2f488449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cfb8ff5a06d455c981ce7051e424aa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG os_brick.utils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da27ea1-2ba1-4025-9190-34f91c12f3bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Successfully created port: f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fb22ba-7d2d-4666-ae4b-e62458b71647]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6e1b53-df76-4178-b44b-8f86e71a6200]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4a9914-4d06-4513-be8c-e231b460d65a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:58:12 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:58:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bf3891-19a1-4a5a-8e75-798f0451d732]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG os_brick.utils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:58:12 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating existing volume attachment record: 6b7fbe05-b9f2-452d-a129-39f366eae841 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Successfully created port: b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Successfully created port: 43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Successfully created port: 9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:58:13 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Creating image(s)
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Ensure instance console log exists: /opt/stack/data/nova/instances/fab159b1-8768-4266-9a2f-3983628aeb86/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Start _get_guest_xml network_info=[{"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtdpoZls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fab159b1-8768-4266-9a2f-3983628aeb86', 'attached_at': '', 'detached_at': '', 'volume_id': '9edaab1d-3869-4da4-81e8-39c0bd9687a1', 'serial': '9edaab1d-3869-4da4-81e8-39c0bd9687a1'}, 'boot_index': 0, 'attachment_id': '0814fc2a-7beb-41ee-a8bf-4c972100b6e4', 'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:58:13 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:58:13 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connector [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Factory for ISCSI on None {{(pid=74540) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtdpoZls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:58:13 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:58:13 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:58:13 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 03:58:13 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Successfully created port: 57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2a14d2-352a-4d9f-8391-3ee0a1db50eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 03:58:13 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e841a1b5-cc94-4d6a-8742-85adddff3702]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1] added
Nov 07 03:58:13 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfab738-baa0-44e7-ad82-0d5c83431427]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a3cfc0-e231-47d5-8fde-1f83422bd104]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtdpoZls {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtdpoZls" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e094501-ab2e-4ac6-a4da-fd56a3940198]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LtdpoZls'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14d2935-41b3-411e-a4ff-e65d0e1d92d9]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1730995b-0bd5-4a6e-955f-c26460db771b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 03:58:13 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 03:58:13 user nova-compute[74540]:  {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:58:13 user nova-compute[74540]: WARNING os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 03:58:13 user nova-compute[74540]: 
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b600ff3-fabe-4acd-a39e-66d646a486b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1, portal: 172.16.0.220,3260]
Nov 07 03:58:13 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1, portal: 172.16.0.220,3260] successful.
Nov 07 03:58:13 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:58:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f500b546-aba2-41f2-8d15-00ff355de61e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b890526e-ac36-4e4e-b0c4-71f288753ba2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:58:14 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:58:14 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[140e90a5-606d-447a-ab63-640b03b93824]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtdpoZls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Successfully created port: f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Successfully created port: 819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:58:14 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Successfully created port: 18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23665636561363035', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665636561363035', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-61761870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-61761870',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPey593voBblcXjUX6Rj4hYhQPXoWv5V3hZq/5nyg3saBjuq6wINCmOescCqsyejhlbUtRTx0iTq9cl/OfUi4sD2g9/3+n6UDIpNBD8OFscEKTzQMZbZpWSKD/LM735sYw==',key_name='tempest-keypair-1948852252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb1ae9772ccb4183b607084edfb8c314',ramdisk_id='',reservation_id='r-bd4tsznq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1901483781',owner_user_name='tempest-ServerActionsV293TestJSON-1901483781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aebf4eecd5445e3a118203654ae2dbe',uuid=fab159b1-8768-4266-9a2f-3983628aeb86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Converting VIF {"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:47,bridge_name='br-int',has_traffic_filtering=True,id=8689cc10-30f0-488d-abae-c8edc08c9750,network=Network(fe9b8c07-cd79-4cc9-9261-16946a99ce2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8689cc10-30') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.objects.instance [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lazy-loading 'pci_devices' on Instance uuid fab159b1-8768-4266-9a2f-3983628aeb86 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Successfully created port: 457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:58:15 user nova-compute[74540]:   <uuid>fab159b1-8768-4266-9a2f-3983628aeb86</uuid>
Nov 07 03:58:15 user nova-compute[74540]:   <name>instance-0000000a</name>
Nov 07 03:58:15 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:58:15 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:58:15 user nova-compute[74540]:   <metadata>
Nov 07 03:58:15 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:58:15 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:58:15 user nova-compute[74540]:       <nova:name>tempest-ServerActionsV293TestJSON-server-61761870</nova:name>
Nov 07 03:58:15 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:58:13</nova:creationTime>
Nov 07 03:58:15 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:58:15 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:58:15 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:58:15 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:58:15 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:58:15 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:58:15 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:58:15 user nova-compute[74540]:       <nova:owner>
Nov 07 03:58:15 user nova-compute[74540]:         <nova:user uuid="3aebf4eecd5445e3a118203654ae2dbe">tempest-ServerActionsV293TestJSON-1901483781-project-member</nova:user>
Nov 07 03:58:15 user nova-compute[74540]:         <nova:project uuid="fb1ae9772ccb4183b607084edfb8c314">tempest-ServerActionsV293TestJSON-1901483781</nova:project>
Nov 07 03:58:15 user nova-compute[74540]:       </nova:owner>
Nov 07 03:58:15 user nova-compute[74540]:       <nova:ports>
Nov 07 03:58:15 user nova-compute[74540]:         <nova:port uuid="8689cc10-30f0-488d-abae-c8edc08c9750">
Nov 07 03:58:15 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 03:58:15 user nova-compute[74540]:         </nova:port>
Nov 07 03:58:15 user nova-compute[74540]:       </nova:ports>
Nov 07 03:58:15 user nova-compute[74540]:     </nova:instance>
Nov 07 03:58:15 user nova-compute[74540]:   </metadata>
Nov 07 03:58:15 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:58:15 user nova-compute[74540]:     <system>
Nov 07 03:58:15 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:58:15 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:58:15 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:58:15 user nova-compute[74540]:       <entry name="serial">fab159b1-8768-4266-9a2f-3983628aeb86</entry>
Nov 07 03:58:15 user nova-compute[74540]:       <entry name="uuid">fab159b1-8768-4266-9a2f-3983628aeb86</entry>
Nov 07 03:58:15 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:58:15 user nova-compute[74540]:     </system>
Nov 07 03:58:15 user nova-compute[74540]:   </sysinfo>
Nov 07 03:58:15 user nova-compute[74540]:   <os>
Nov 07 03:58:15 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:58:15 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 03:58:15 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:58:15 user nova-compute[74540]:   </os>
Nov 07 03:58:15 user nova-compute[74540]:   <features>
Nov 07 03:58:15 user nova-compute[74540]:     <acpi/>
Nov 07 03:58:15 user nova-compute[74540]:     <apic/>
Nov 07 03:58:15 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:58:15 user nova-compute[74540]:   </features>
Nov 07 03:58:15 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:58:15 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:58:15 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:58:15 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:58:15 user nova-compute[74540]:   </clock>
Nov 07 03:58:15 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:58:15 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:58:15 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:58:15 user nova-compute[74540]:   </cpu>
Nov 07 03:58:15 user nova-compute[74540]:   <devices>
Nov 07 03:58:15 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 03:58:15 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 03:58:15 user nova-compute[74540]:       <source dev="/dev/sdb"/>
Nov 07 03:58:15 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 03:58:15 user nova-compute[74540]:       <serial>9edaab1d-3869-4da4-81e8-39c0bd9687a1</serial>
Nov 07 03:58:15 user nova-compute[74540]:     </disk>
Nov 07 03:58:15 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:58:15 user nova-compute[74540]:       <mac address="fa:16:3e:f5:c3:47"/>
Nov 07 03:58:15 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:58:15 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:58:15 user nova-compute[74540]:       <target dev="tap8689cc10-30"/>
Nov 07 03:58:15 user nova-compute[74540]:     </interface>
Nov 07 03:58:15 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:58:15 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/fab159b1-8768-4266-9a2f-3983628aeb86/console.log" append="off"/>
Nov 07 03:58:15 user nova-compute[74540]:     </serial>
Nov 07 03:58:15 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:58:15 user nova-compute[74540]:     <video>
Nov 07 03:58:15 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:58:15 user nova-compute[74540]:     </video>
Nov 07 03:58:15 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:58:15 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:58:15 user nova-compute[74540]:     </rng>
Nov 07 03:58:15 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:58:15 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:58:15 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:58:15 user nova-compute[74540]:     </memballoon>
Nov 07 03:58:15 user nova-compute[74540]:   </devices>
Nov 07 03:58:15 user nova-compute[74540]: </domain>
Nov 07 03:58:15 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-61761870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-61761870',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPey593voBblcXjUX6Rj4hYhQPXoWv5V3hZq/5nyg3saBjuq6wINCmOescCqsyejhlbUtRTx0iTq9cl/OfUi4sD2g9/3+n6UDIpNBD8OFscEKTzQMZbZpWSKD/LM735sYw==',key_name='tempest-keypair-1948852252',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb1ae9772ccb4183b607084edfb8c314',ramdisk_id='',reservation_id='r-bd4tsznq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1901483781',owner_user_name='tempest-ServerActionsV293TestJSON-1901483781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aebf4eecd5445e3a118203654ae2dbe',uuid=fab159b1-8768-4266-9a2f-3983628aeb86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Converting VIF {"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:47,bridge_name='br-int',has_traffic_filtering=True,id=8689cc10-30f0-488d-abae-c8edc08c9750,network=Network(fe9b8c07-cd79-4cc9-9261-16946a99ce2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8689cc10-30') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG os_vif [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:47,bridge_name='br-int',has_traffic_filtering=True,id=8689cc10-30f0-488d-abae-c8edc08c9750,network=Network(fe9b8c07-cd79-4cc9-9261-16946a99ce2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8689cc10-30') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41253102-9e89-5f72-a0e6-c357f64da560', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8689cc10-30, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8689cc10-30, col_values=(('qos', UUID('1ed6bf82-d18d-43c0-86fd-1021ccda1148')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8689cc10-30, col_values=(('external_ids', {'iface-id': '8689cc10-30f0-488d-abae-c8edc08c9750', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c3:47', 'vm-uuid': 'fab159b1-8768-4266-9a2f-3983628aeb86'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:15 user nova-compute[74540]: INFO os_vif [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:47,bridge_name='br-int',has_traffic_filtering=True,id=8689cc10-30f0-488d-abae-c8edc08c9750,network=Network(fe9b8c07-cd79-4cc9-9261-16946a99ce2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8689cc10-30')
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] No VIF found with MAC fa:16:3e:f5:c3:47, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Successfully updated port: f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-518d823f-46c4-476b-9f77-0acbf6549b98 req-940f0e9c-d590-430f-a867-2b04dea78531 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-changed-f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-518d823f-46c4-476b-9f77-0acbf6549b98 req-940f0e9c-d590-430f-a867-2b04dea78531 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing instance network info cache due to event network-changed-f821c840-d892-434e-a289-affbb1fd08b6. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-518d823f-46c4-476b-9f77-0acbf6549b98 req-940f0e9c-d590-430f-a867-2b04dea78531 service nova] Acquiring lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-518d823f-46c4-476b-9f77-0acbf6549b98 req-940f0e9c-d590-430f-a867-2b04dea78531 service nova] Acquired lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.network.neutron [req-518d823f-46c4-476b-9f77-0acbf6549b98 req-940f0e9c-d590-430f-a867-2b04dea78531 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing network info cache for port f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:15 user nova-compute[74540]: DEBUG nova.network.neutron [req-518d823f-46c4-476b-9f77-0acbf6549b98 req-940f0e9c-d590-430f-a867-2b04dea78531 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG nova.network.neutron [req-518d823f-46c4-476b-9f77-0acbf6549b98 req-940f0e9c-d590-430f-a867-2b04dea78531 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-518d823f-46c4-476b-9f77-0acbf6549b98 req-940f0e9c-d590-430f-a867-2b04dea78531 service nova] Releasing lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Successfully created port: 33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Successfully updated port: a0750b9d-bbac-490f-af0f-f4ca13768c3c {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG nova.compute.manager [req-e835d9c1-cf4d-446c-afe6-18190e2e925c req-f0ef2f78-fbde-45ba-8260-bb1cf666029d service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Received event network-vif-plugged-8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e835d9c1-cf4d-446c-afe6-18190e2e925c req-f0ef2f78-fbde-45ba-8260-bb1cf666029d service nova] Acquiring lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e835d9c1-cf4d-446c-afe6-18190e2e925c req-f0ef2f78-fbde-45ba-8260-bb1cf666029d service nova] Lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e835d9c1-cf4d-446c-afe6-18190e2e925c req-f0ef2f78-fbde-45ba-8260-bb1cf666029d service nova] Lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:16 user nova-compute[74540]: DEBUG nova.compute.manager [req-e835d9c1-cf4d-446c-afe6-18190e2e925c req-f0ef2f78-fbde-45ba-8260-bb1cf666029d service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] No waiting events found dispatching network-vif-plugged-8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:58:16 user nova-compute[74540]: WARNING nova.compute.manager [req-e835d9c1-cf4d-446c-afe6-18190e2e925c req-f0ef2f78-fbde-45ba-8260-bb1cf666029d service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Received unexpected event network-vif-plugged-8689cc10-30f0-488d-abae-c8edc08c9750 for instance with vm_state building and task_state spawning.
Nov 07 03:58:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:17 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Successfully updated port: b211e9e5-243c-481c-bfef-6b3a9c532a3c {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-changed-a0750b9d-bbac-490f-af0f-f4ca13768c3c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing instance network info cache due to event network-changed-a0750b9d-bbac-490f-af0f-f4ca13768c3c. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] Acquiring lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] Acquired lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:17 user nova-compute[74540]: DEBUG nova.network.neutron [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing network info cache for port a0750b9d-bbac-490f-af0f-f4ca13768c3c {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:17 user nova-compute[74540]: DEBUG nova.network.neutron [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:17 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Successfully updated port: 43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:17 user nova-compute[74540]: DEBUG nova.network.neutron [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] Releasing lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-changed-b211e9e5-243c-481c-bfef-6b3a9c532a3c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing instance network info cache due to event network-changed-b211e9e5-243c-481c-bfef-6b3a9c532a3c. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] Acquiring lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] Acquired lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing network info cache for port b211e9e5-243c-481c-bfef-6b3a9c532a3c {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Successfully updated port: b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0981d582-0187-4560-8eda-e2783b1f8514 req-2ad5f147-4105-422d-9e39-2982e94167c2 service nova] Releasing lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Successfully updated port: 9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Successfully updated port: 8eee84ce-8974-4c32-8f84-7e399c631085 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 03:58:18 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Instance spawned successfully.
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:58:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:58:19 user nova-compute[74540]: INFO nova.compute.manager [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Received event network-vif-plugged-8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] Acquiring lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] Lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] Lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] No waiting events found dispatching network-vif-plugged-8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:58:19 user nova-compute[74540]: WARNING nova.compute.manager [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Received unexpected event network-vif-plugged-8689cc10-30f0-488d-abae-c8edc08c9750 for instance with vm_state building and task_state spawning.
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-changed-43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing instance network info cache due to event network-changed-43c2db66-9652-40e8-8b69-3b9cc77cd456. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] Acquiring lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] Acquired lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing network info cache for port 43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:19 user nova-compute[74540]: INFO nova.compute.manager [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Took 31.07 seconds to build instance.
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0613fa9d-0bce-450b-becb-9d3067a34c12 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "fab159b1-8768-4266-9a2f-3983628aeb86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.177s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Successfully updated port: f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] Releasing lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-changed-8eee84ce-8974-4c32-8f84-7e399c631085 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing instance network info cache due to event network-changed-8eee84ce-8974-4c32-8f84-7e399c631085. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] Acquiring lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] Acquired lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing network info cache for port 8eee84ce-8974-4c32-8f84-7e399c631085 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-changed-b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing instance network info cache due to event network-changed-b806d809-0e35-4345-8665-d3e15ad73b59. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] Acquiring lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] Acquired lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing network info cache for port b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fda9549b-8ff1-4ac1-a99a-b11ad2f47895 req-c9653099-2c75-4cc1-ab82-c1e7e715169d service nova] Releasing lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] Releasing lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG nova.compute.manager [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-changed-9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG nova.compute.manager [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing instance network info cache due to event network-changed-9254f39e-f860-47d2-b274-12d409c79d83. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] Acquiring lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] Acquired lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing network info cache for port 9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Successfully updated port: 53b6e456-7f50-428b-a729-8acbb635add5 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] Releasing lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG nova.compute.manager [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-changed-f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG nova.compute.manager [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing instance network info cache due to event network-changed-f10c9e61-e28f-4432-b85e-a91c1a205b1a. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] Acquiring lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] Acquired lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing network info cache for port f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-ed321da5-d11a-4671-b290-1b2590e4f90a req-40a67889-3a48-4e76-a6d3-5f5deda1da1d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-changed-53b6e456-7f50-428b-a729-8acbb635add5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-ed321da5-d11a-4671-b290-1b2590e4f90a req-40a67889-3a48-4e76-a6d3-5f5deda1da1d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing instance network info cache due to event network-changed-53b6e456-7f50-428b-a729-8acbb635add5. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ed321da5-d11a-4671-b290-1b2590e4f90a req-40a67889-3a48-4e76-a6d3-5f5deda1da1d service nova] Acquiring lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ed321da5-d11a-4671-b290-1b2590e4f90a req-40a67889-3a48-4e76-a6d3-5f5deda1da1d service nova] Acquired lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG nova.network.neutron [req-ed321da5-d11a-4671-b290-1b2590e4f90a req-40a67889-3a48-4e76-a6d3-5f5deda1da1d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing network info cache for port 53b6e456-7f50-428b-a729-8acbb635add5 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG nova.network.neutron [req-ed321da5-d11a-4671-b290-1b2590e4f90a req-40a67889-3a48-4e76-a6d3-5f5deda1da1d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG nova.network.neutron [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Successfully updated port: 18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6ffec349-6244-4344-b39b-b209bd51400e req-388f0498-cdc5-400b-81c4-074049b61ad8 service nova] Releasing lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquired lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG nova.network.neutron [req-ed321da5-d11a-4671-b290-1b2590e4f90a req-40a67889-3a48-4e76-a6d3-5f5deda1da1d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ed321da5-d11a-4671-b290-1b2590e4f90a req-40a67889-3a48-4e76-a6d3-5f5deda1da1d service nova] Releasing lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:21 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Successfully updated port: 57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-changed-18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing instance network info cache due to event network-changed-18407b84-616b-4e09-98f0-1fe082ecd8ec. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] Acquiring lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:23 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Successfully updated port: 819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:58:24 user nova-compute[74540]: INFO nova.compute.manager [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Rescuing
Nov 07 03:58:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquired lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:24 user nova-compute[74540]: DEBUG nova.network.neutron [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:58:24 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Successfully updated port: 457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:58:24 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [{"id": "f821c840-d892-434e-a289-affbb1fd08b6", "address": "fa:16:3e:36:80:ce", "network": {"id": "ddefaf54-73f2-48fa-9dd2-1c41aec51746", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1771812249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf821c840-d8", "ovs_interfaceid": "f821c840-d892-434e-a289-affbb1fd08b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "address": "fa:16:3e:22:ac:ce", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10c9e61-e2", "ovs_interfaceid": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Releasing lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Instance network_info: |[{"id": "f821c840-d892-434e-a289-affbb1fd08b6", "address": "fa:16:3e:36:80:ce", "network": {"id": "ddefaf54-73f2-48fa-9dd2-1c41aec51746", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1771812249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf821c840-d8", "ovs_interfaceid": "f821c840-d892-434e-a289-affbb1fd08b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "address": "fa:16:3e:22:ac:ce", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10c9e61-e2", "ovs_interfaceid": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:58:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] Acquired lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:24 user nova-compute[74540]: DEBUG nova.network.neutron [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing network info cache for port 18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.network.neutron [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Updating instance_info_cache with network_info: [{"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Releasing lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-changed-819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing instance network info cache due to event network-changed-819961d9-d8e8-4cfb-b022-4a2eb954754a. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] Acquiring lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] Acquired lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.network.neutron [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing network info cache for port 819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.network.neutron [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.network.neutron [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updated VIF entry in instance network info cache for port 18407b84-616b-4e09-98f0-1fe082ecd8ec. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.network.neutron [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [{"id": "f821c840-d892-434e-a289-affbb1fd08b6", "address": "fa:16:3e:36:80:ce", "network": {"id": "ddefaf54-73f2-48fa-9dd2-1c41aec51746", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1771812249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf821c840-d8", "ovs_interfaceid": "f821c840-d892-434e-a289-affbb1fd08b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "address": "fa:16:3e:22:ac:ce", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10c9e61-e2", "ovs_interfaceid": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] Releasing lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-changed-57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing instance network info cache due to event network-changed-57eef42e-ec2b-44c5-aa5b-45e943f783e2. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] Acquiring lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.network.neutron [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] Releasing lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-changed-457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing instance network info cache due to event network-changed-457812a7-f900-488c-9044-0eb5eccbe506. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] Acquiring lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] Acquired lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.network.neutron [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing network info cache for port 457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:58:25 user nova-compute[74540]: DEBUG nova.network.neutron [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.network.neutron [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c2033fcd-606b-46c7-b90c-11baaf53dafb req-4d825771-4258-42c7-9f58-f9e07733bcd0 service nova] Releasing lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] Acquired lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.network.neutron [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing network info cache for port 57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Successfully updated port: 33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:26 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Instance destroyed successfully.
Nov 07 03:58:26 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Attempting rescue
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74540) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Instance directory exists: not creating {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 03:58:26 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Creating image(s)
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "/opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "/opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "/opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.objects.instance [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'trusted_certs' on Instance uuid f146d8c3-a189-49da-84d0-b49dc77e4144 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.network.neutron [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.network.neutron [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue" returned: 0 in 0.066s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.objects.instance [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'migration_context' on Instance uuid f146d8c3-a189-49da-84d0-b49dc77e4144 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-334cd702-5f57-4323-863a-667ed5c2fa4b req-12b9f1c7-0c5f-4eac-b453-537639627a0f service nova] Releasing lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.objects.base [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<f146d8c3-a189-49da-84d0-b49dc77e4144> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Start _get_guest_xml network_info=[{"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "vif_mac": "fa:16:3e:9b:b1:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.objects.instance [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'resources' on Instance uuid f146d8c3-a189-49da-84d0-b49dc77e4144 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquired lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.objects.base [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<f146d8c3-a189-49da-84d0-b49dc77e4144> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.objects.instance [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'numa_topology' on Instance uuid f146d8c3-a189-49da-84d0-b49dc77e4144 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.objects.base [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<f146d8c3-a189-49da-84d0-b49dc77e4144> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 03:58:26 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:58:26 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.objects.instance [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'vcpu_model' on Instance uuid f146d8c3-a189-49da-84d0-b49dc77e4144 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.objects.base [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<f146d8c3-a189-49da-84d0-b49dc77e4144> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1630826878',display_name='tempest-ServerRescueNegativeTestJSON-server-1630826878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1630826878',id=2,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60a9f3df6bba4675b2332ac4ded5373e',ramdisk_id='',reservation_id='r-dh60fwvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1326022799',owner_user_name='tempest-ServerRescueNegativeTestJSON-1326022799-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:51Z,user_data=None,user_id='c3b660fa816a404196af3027d19aea51',uuid=f146d8c3-a189-49da-84d0-b49dc77e4144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "vif_mac": "fa:16:3e:9b:b1:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converting VIF {"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "vif_mac": "fa:16:3e:9b:b1:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:b1:e2,bridge_name='br-int',has_traffic_filtering=True,id=ec7cc688-a3a0-46a3-aa63-6e32ca5bf216,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7cc688-a3') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.objects.instance [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'pci_devices' on Instance uuid f146d8c3-a189-49da-84d0-b49dc77e4144 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.objects.base [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<f146d8c3-a189-49da-84d0-b49dc77e4144> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:58:26 user nova-compute[74540]:   <uuid>f146d8c3-a189-49da-84d0-b49dc77e4144</uuid>
Nov 07 03:58:26 user nova-compute[74540]:   <name>instance-00000002</name>
Nov 07 03:58:26 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:58:26 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:58:26 user nova-compute[74540]:   <metadata>
Nov 07 03:58:26 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:58:26 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:58:26 user nova-compute[74540]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1630826878</nova:name>
Nov 07 03:58:26 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:58:26</nova:creationTime>
Nov 07 03:58:26 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:58:26 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:58:26 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:58:26 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:58:26 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:58:26 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:58:26 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:58:26 user nova-compute[74540]:       <nova:owner>
Nov 07 03:58:26 user nova-compute[74540]:         <nova:user uuid="c3b660fa816a404196af3027d19aea51">tempest-ServerRescueNegativeTestJSON-1326022799-project-member</nova:user>
Nov 07 03:58:26 user nova-compute[74540]:         <nova:project uuid="60a9f3df6bba4675b2332ac4ded5373e">tempest-ServerRescueNegativeTestJSON-1326022799</nova:project>
Nov 07 03:58:26 user nova-compute[74540]:       </nova:owner>
Nov 07 03:58:26 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 03:58:26 user nova-compute[74540]:       <nova:ports>
Nov 07 03:58:26 user nova-compute[74540]:         <nova:port uuid="ec7cc688-a3a0-46a3-aa63-6e32ca5bf216">
Nov 07 03:58:26 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 03:58:26 user nova-compute[74540]:         </nova:port>
Nov 07 03:58:26 user nova-compute[74540]:       </nova:ports>
Nov 07 03:58:26 user nova-compute[74540]:     </nova:instance>
Nov 07 03:58:26 user nova-compute[74540]:   </metadata>
Nov 07 03:58:26 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:58:26 user nova-compute[74540]:     <system>
Nov 07 03:58:26 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:58:26 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:58:26 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:58:26 user nova-compute[74540]:       <entry name="serial">f146d8c3-a189-49da-84d0-b49dc77e4144</entry>
Nov 07 03:58:26 user nova-compute[74540]:       <entry name="uuid">f146d8c3-a189-49da-84d0-b49dc77e4144</entry>
Nov 07 03:58:26 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:58:26 user nova-compute[74540]:     </system>
Nov 07 03:58:26 user nova-compute[74540]:   </sysinfo>
Nov 07 03:58:26 user nova-compute[74540]:   <os>
Nov 07 03:58:26 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:58:26 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:58:26 user nova-compute[74540]:   </os>
Nov 07 03:58:26 user nova-compute[74540]:   <features>
Nov 07 03:58:26 user nova-compute[74540]:     <acpi/>
Nov 07 03:58:26 user nova-compute[74540]:     <apic/>
Nov 07 03:58:26 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:58:26 user nova-compute[74540]:   </features>
Nov 07 03:58:26 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:58:26 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:58:26 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:58:26 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:58:26 user nova-compute[74540]:   </clock>
Nov 07 03:58:26 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:58:26 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:58:26 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:58:26 user nova-compute[74540]:   </cpu>
Nov 07 03:58:26 user nova-compute[74540]:   <devices>
Nov 07 03:58:26 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 03:58:26 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 03:58:26 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue"/>
Nov 07 03:58:26 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 03:58:26 user nova-compute[74540]:     </disk>
Nov 07 03:58:26 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 03:58:26 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 03:58:26 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk"/>
Nov 07 03:58:26 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 03:58:26 user nova-compute[74540]:     </disk>
Nov 07 03:58:26 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:58:26 user nova-compute[74540]:       <mac address="fa:16:3e:9b:b1:e2"/>
Nov 07 03:58:26 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:58:26 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:58:26 user nova-compute[74540]:       <target dev="tapec7cc688-a3"/>
Nov 07 03:58:26 user nova-compute[74540]:     </interface>
Nov 07 03:58:26 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:58:26 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/console.log" append="off"/>
Nov 07 03:58:26 user nova-compute[74540]:     </serial>
Nov 07 03:58:26 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:58:26 user nova-compute[74540]:     <video>
Nov 07 03:58:26 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:58:26 user nova-compute[74540]:     </video>
Nov 07 03:58:26 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:58:26 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:58:26 user nova-compute[74540]:     </rng>
Nov 07 03:58:26 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:58:26 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:58:26 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:58:26 user nova-compute[74540]:     </memballoon>
Nov 07 03:58:26 user nova-compute[74540]:   </devices>
Nov 07 03:58:26 user nova-compute[74540]: </domain>
Nov 07 03:58:26 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:58:26 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Instance destroyed successfully.
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:58:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No VIF found with MAC fa:16:3e:9b:b1:e2, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-57dc4bc1-e13c-4895-b808-0617d838696b req-64f027f7-4487-44d4-a182-edd5855fd5b5 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-changed-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-57dc4bc1-e13c-4895-b808-0617d838696b req-64f027f7-4487-44d4-a182-edd5855fd5b5 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Refreshing instance network info cache due to event network-changed-b624973a-ace1-47d7-8733-2a76e946eaec. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-57dc4bc1-e13c-4895-b808-0617d838696b req-64f027f7-4487-44d4-a182-edd5855fd5b5 service nova] Acquiring lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-57dc4bc1-e13c-4895-b808-0617d838696b req-64f027f7-4487-44d4-a182-edd5855fd5b5 service nova] Acquired lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG nova.network.neutron [req-57dc4bc1-e13c-4895-b808-0617d838696b req-64f027f7-4487-44d4-a182-edd5855fd5b5 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Refreshing network info cache for port b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received event network-vif-unplugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] No waiting events found dispatching network-vif-unplugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:58:27 user nova-compute[74540]: WARNING nova.compute.manager [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received unexpected event network-vif-unplugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 for instance with vm_state active and task_state rescuing.
Nov 07 03:58:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-changed-33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing instance network info cache due to event network-changed-33bb75e6-7891-4c52-874c-855c3c1ac9c5. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] Acquiring lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG nova.network.neutron [req-57dc4bc1-e13c-4895-b808-0617d838696b req-64f027f7-4487-44d4-a182-edd5855fd5b5 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updated VIF entry in instance network info cache for port b624973a-ace1-47d7-8733-2a76e946eaec. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG nova.network.neutron [req-57dc4bc1-e13c-4895-b808-0617d838696b req-64f027f7-4487-44d4-a182-edd5855fd5b5 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updating instance_info_cache with network_info: [{"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-57dc4bc1-e13c-4895-b808-0617d838696b req-64f027f7-4487-44d4-a182-edd5855fd5b5 service nova] Releasing lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:27 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Updating instance_info_cache with network_info: [{"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:58:28 user nova-compute[74540]: INFO nova.compute.manager [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] instance snapshotting
Nov 07 03:58:28 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [{"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457812a7-f900-488c-9044-0eb5eccbe506", "address": "fa:16:3e:82:aa:43", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457812a7-f9", "ovs_interfaceid": "457812a7-f900-488c-9044-0eb5eccbe506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "address": "fa:16:3e:0e:5c:b7", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb75e6-78", "ovs_interfaceid": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Releasing lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Instance network_info: |[{"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457812a7-f900-488c-9044-0eb5eccbe506", "address": "fa:16:3e:82:aa:43", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457812a7-f9", "ovs_interfaceid": "457812a7-f900-488c-9044-0eb5eccbe506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "address": "fa:16:3e:0e:5c:b7", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb75e6-78", "ovs_interfaceid": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] Acquired lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG nova.network.neutron [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing network info cache for port 33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:28 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Beginning live snapshot process
Nov 07 03:58:28 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:28 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json -f qcow2 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json -f qcow2" returned: 0 in 0.241s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json -f qcow2 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG nova.network.neutron [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updated VIF entry in instance network info cache for port 33bb75e6-7891-4c52-874c-855c3c1ac9c5. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG nova.network.neutron [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [{"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457812a7-f900-488c-9044-0eb5eccbe506", "address": "fa:16:3e:82:aa:43", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457812a7-f9", "ovs_interfaceid": "457812a7-f900-488c-9044-0eb5eccbe506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "address": "fa:16:3e:0e:5c:b7", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb75e6-78", "ovs_interfaceid": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] Releasing lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received event network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] No waiting events found dispatching network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:58:29 user nova-compute[74540]: WARNING nova.compute.manager [req-f7c2228e-b3ae-4edf-af4f-acee85676606 req-3a02f2c9-836f-4e95-9d9d-e129f5802f51 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received unexpected event network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 for instance with vm_state active and task_state rescuing.
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-d6ba8e62-12f0-4001-86c0-05f0f1015283 req-871d773f-d829-42da-af56-d783876c2482 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received event network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d6ba8e62-12f0-4001-86c0-05f0f1015283 req-871d773f-d829-42da-af56-d783876c2482 service nova] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d6ba8e62-12f0-4001-86c0-05f0f1015283 req-871d773f-d829-42da-af56-d783876c2482 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d6ba8e62-12f0-4001-86c0-05f0f1015283 req-871d773f-d829-42da-af56-d783876c2482 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-d6ba8e62-12f0-4001-86c0-05f0f1015283 req-871d773f-d829-42da-af56-d783876c2482 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] No waiting events found dispatching network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:58:29 user nova-compute[74540]: WARNING nova.compute.manager [req-d6ba8e62-12f0-4001-86c0-05f0f1015283 req-871d773f-d829-42da-af56-d783876c2482 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received unexpected event network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 for instance with vm_state active and task_state rescuing.
Nov 07 03:58:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-d6ba8e62-12f0-4001-86c0-05f0f1015283 req-871d773f-d829-42da-af56-d783876c2482 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received event network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d6ba8e62-12f0-4001-86c0-05f0f1015283 req-871d773f-d829-42da-af56-d783876c2482 service nova] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d6ba8e62-12f0-4001-86c0-05f0f1015283 req-871d773f-d829-42da-af56-d783876c2482 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d6ba8e62-12f0-4001-86c0-05f0f1015283 req-871d773f-d829-42da-af56-d783876c2482 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-d6ba8e62-12f0-4001-86c0-05f0f1015283 req-871d773f-d829-42da-af56-d783876c2482 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] No waiting events found dispatching network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:58:29 user nova-compute[74540]: WARNING nova.compute.manager [req-d6ba8e62-12f0-4001-86c0-05f0f1015283 req-871d773f-d829-42da-af56-d783876c2482 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received unexpected event network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 for instance with vm_state active and task_state rescuing.
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.203s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn0c80z98/5781ba41d215478ca55a054d867407bb.delta 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn0c80z98/5781ba41d215478ca55a054d867407bb.delta 1073741824" returned: 0 in 0.056s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:29 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 07 03:58:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74540) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 07 03:58:29 user nova-compute[74540]: INFO nova.virt.libvirt.host [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] UEFI support detected
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6fc6f94-fe32-49ae-8224-6b2112035670 req-10dd7f65-09a7-41c5-a734-4541e0baff18 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Received event network-changed-ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-b6fc6f94-fe32-49ae-8224-6b2112035670 req-10dd7f65-09a7-41c5-a734-4541e0baff18 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Refreshing instance network info cache due to event network-changed-ec97afff-dfc2-423f-b6d9-7f0e807144d9. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6fc6f94-fe32-49ae-8224-6b2112035670 req-10dd7f65-09a7-41c5-a734-4541e0baff18 service nova] Acquiring lock "refresh_cache-d6501f90-9180-4e99-a294-9ffba799c247" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6fc6f94-fe32-49ae-8224-6b2112035670 req-10dd7f65-09a7-41c5-a734-4541e0baff18 service nova] Acquired lock "refresh_cache-d6501f90-9180-4e99-a294-9ffba799c247" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG nova.network.neutron [req-b6fc6f94-fe32-49ae-8224-6b2112035670 req-10dd7f65-09a7-41c5-a734-4541e0baff18 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Refreshing network info cache for port ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-884fa033-1653-49aa-8325-6d8208cf5a39 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-76c6a2b3-6eca-4c08-bdf9-61fa65c0631b req-944b2d83-3797-427f-84e5-b6c60600455a service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-changed-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-76c6a2b3-6eca-4c08-bdf9-61fa65c0631b req-944b2d83-3797-427f-84e5-b6c60600455a service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Refreshing instance network info cache due to event network-changed-27e96706-586b-4c99-9b76-6073a1dda1c8. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-76c6a2b3-6eca-4c08-bdf9-61fa65c0631b req-944b2d83-3797-427f-84e5-b6c60600455a service nova] Acquiring lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-76c6a2b3-6eca-4c08-bdf9-61fa65c0631b req-944b2d83-3797-427f-84e5-b6c60600455a service nova] Acquired lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG nova.network.neutron [req-76c6a2b3-6eca-4c08-bdf9-61fa65c0631b req-944b2d83-3797-427f-84e5-b6c60600455a service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Refreshing network info cache for port 27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] COPY block job progress, current cursor: 983040 final cursor: 75497472 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG nova.network.neutron [req-b6fc6f94-fe32-49ae-8224-6b2112035670 req-10dd7f65-09a7-41c5-a734-4541e0baff18 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Updated VIF entry in instance network info cache for port ec97afff-dfc2-423f-b6d9-7f0e807144d9. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG nova.network.neutron [req-b6fc6f94-fe32-49ae-8224-6b2112035670 req-10dd7f65-09a7-41c5-a734-4541e0baff18 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Updating instance_info_cache with network_info: [{"id": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "address": "fa:16:3e:5c:97:16", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec97afff-df", "ovs_interfaceid": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b6fc6f94-fe32-49ae-8224-6b2112035670 req-10dd7f65-09a7-41c5-a734-4541e0baff18 service nova] Releasing lock "refresh_cache-d6501f90-9180-4e99-a294-9ffba799c247" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 03:58:31 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 07 03:58:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn0c80z98/5781ba41d215478ca55a054d867407bb.delta /opt/stack/data/nova/instances/snapshots/tmpn0c80z98/5781ba41d215478ca55a054d867407bb {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG nova.network.neutron [req-76c6a2b3-6eca-4c08-bdf9-61fa65c0631b req-944b2d83-3797-427f-84e5-b6c60600455a service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updated VIF entry in instance network info cache for port 27e96706-586b-4c99-9b76-6073a1dda1c8. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG nova.network.neutron [req-76c6a2b3-6eca-4c08-bdf9-61fa65c0631b req-944b2d83-3797-427f-84e5-b6c60600455a service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating instance_info_cache with network_info: [{"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-76c6a2b3-6eca-4c08-bdf9-61fa65c0631b req-944b2d83-3797-427f-84e5-b6c60600455a service nova] Releasing lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn0c80z98/5781ba41d215478ca55a054d867407bb.delta /opt/stack/data/nova/instances/snapshots/tmpn0c80z98/5781ba41d215478ca55a054d867407bb" returned: 0 in 0.526s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:31 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Snapshot extracted, beginning image upload
Nov 07 03:58:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 03:58:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:34 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:58:34 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:58:34 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7176MB free_disk=25.322837829589844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 03:58:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a3cae7a7-223c-438e-8206-39e0f1683cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d6501f90-9180-4e99-a294-9ffba799c247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6d43f26f-dfbb-4299-b875-f498979679d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 8c37887f-4c8a-4808-82a7-f8701dd9b62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d248eae-ef06-4be3-9178-15d54309be59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a78e9806-c043-437c-b085-108eee9a921b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance fab159b1-8768-4266-9a2f-3983628aeb86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance b0838704-02b2-4591-9d88-fe0dedcd8452 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:35 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Snapshot image upload complete
Nov 07 03:58:35 user nova-compute[74540]: INFO nova.compute.manager [None req-e5d944eb-f49a-41d7-9c69-8dd541a6f57c tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Took 6.62 seconds to snapshot the instance on the hypervisor.
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 03:58:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.779s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:36 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:58:36 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:58:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "d6501f90-9180-4e99-a294-9ffba799c247" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "d6501f90-9180-4e99-a294-9ffba799c247" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG nova.objects.instance [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'flavor' on Instance uuid d6501f90-9180-4e99-a294-9ffba799c247 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "d6501f90-9180-4e99-a294-9ffba799c247" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "d6501f90-9180-4e99-a294-9ffba799c247" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "d6501f90-9180-4e99-a294-9ffba799c247" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:58:37 user nova-compute[74540]: INFO nova.compute.manager [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Attaching volume 3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a to /dev/vdb
Nov 07 03:58:37 user nova-compute[74540]: DEBUG os_brick.utils [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e54b041-6d1c-41ef-a021-c6b1c2d2abb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6def5865-af04-4983-8c1c-ddaf6019d0da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4437e3f-0877-4ac0-93b0-e0965e4f29ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[964900aa-a24c-4574-ab70-1757b39bdaed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:58:37 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:58:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8dd595-79ad-44cd-a46f-5c2b104e19e2]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG os_brick.utils [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:58:37 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Updating existing volume attachment record: bfb08a6a-d824-4d20-9f0a-d1e76b164b27 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 03:58:38 user nova-compute[74540]: INFO nova.virt.block_device [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Booting with volume 9e8ef321-04a2-4d5e-bee1-86329d4edc80 at /dev/vdb
Nov 07 03:58:38 user nova-compute[74540]: DEBUG os_brick.utils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[84182066-4e21-4b3b-9431-24d28c2f4d17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ee3cf7-c960-446f-8ae2-9aa81dcc048e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f815bf-04ac-464d-b874-abdab26ec667]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e73760-acf7-4c10-9837-d2abb6137d59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:58:38 user nova-compute[74540]: INFO nova.virt.block_device [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Booting with volume 6586c99b-31cc-4c88-8c66-2af7f3a6d3fd at /dev/vdb
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:58:38 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6485c7f-757a-4f95-974a-dd0734747662]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG os_brick.utils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating existing volume attachment record: 1cd856d4-5139-448b-8d56-bc311753d494 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG os_brick.utils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c58b64-d3c6-45d2-bf72-5a6d1be890dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[597a309e-fa38-43f2-ad70-0a0233d8c96b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[847351da-dce7-434e-a9dc-18865083dd1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb4cc16-1ff0-4b3f-8bb8-3d552f0f0149]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:58:38 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:58:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04e4a83-cad8-4b42-b742-6e77aec93745]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG os_brick.utils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:58:38 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating existing volume attachment record: 31c2eb7d-3b08-4840-8159-f4b156c87b61 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 03:58:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-15e300dd-8128-4e17-b40e-74d52dd33024 req-66868bc1-c71a-4a33-b6a7-3dd50a938730 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received event network-changed-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-15e300dd-8128-4e17-b40e-74d52dd33024 req-66868bc1-c71a-4a33-b6a7-3dd50a938730 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Refreshing instance network info cache due to event network-changed-93c295a9-0e82-4a04-9eab-7dea70ad507c. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-15e300dd-8128-4e17-b40e-74d52dd33024 req-66868bc1-c71a-4a33-b6a7-3dd50a938730 service nova] Acquiring lock "refresh_cache-6d43f26f-dfbb-4299-b875-f498979679d9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-15e300dd-8128-4e17-b40e-74d52dd33024 req-66868bc1-c71a-4a33-b6a7-3dd50a938730 service nova] Acquired lock "refresh_cache-6d43f26f-dfbb-4299-b875-f498979679d9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:40 user nova-compute[74540]: DEBUG nova.network.neutron [req-15e300dd-8128-4e17-b40e-74d52dd33024 req-66868bc1-c71a-4a33-b6a7-3dd50a938730 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Refreshing network info cache for port 93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-15e300dd-8128-4e17-b40e-74d52dd33024 req-66868bc1-c71a-4a33-b6a7-3dd50a938730 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Updated VIF entry in instance network info cache for port 93c295a9-0e82-4a04-9eab-7dea70ad507c. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:58:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-15e300dd-8128-4e17-b40e-74d52dd33024 req-66868bc1-c71a-4a33-b6a7-3dd50a938730 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Updating instance_info_cache with network_info: [{"id": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "address": "fa:16:3e:48:2e:c5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c295a9-0e", "ovs_interfaceid": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-15e300dd-8128-4e17-b40e-74d52dd33024 req-66868bc1-c71a-4a33-b6a7-3dd50a938730 service nova] Releasing lock "refresh_cache-6d43f26f-dfbb-4299-b875-f498979679d9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-f78008a1-7858-4edd-aba7-e089cb161242 req-5f9dd1d7-525c-4904-ac01-2b995a49855f service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Received event network-changed-d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-f78008a1-7858-4edd-aba7-e089cb161242 req-5f9dd1d7-525c-4904-ac01-2b995a49855f service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Refreshing instance network info cache due to event network-changed-d711d258-7e53-4467-93ca-6ed95045095a. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f78008a1-7858-4edd-aba7-e089cb161242 req-5f9dd1d7-525c-4904-ac01-2b995a49855f service nova] Acquiring lock "refresh_cache-8c37887f-4c8a-4808-82a7-f8701dd9b62e" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f78008a1-7858-4edd-aba7-e089cb161242 req-5f9dd1d7-525c-4904-ac01-2b995a49855f service nova] Acquired lock "refresh_cache-8c37887f-4c8a-4808-82a7-f8701dd9b62e" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:52 user nova-compute[74540]: DEBUG nova.network.neutron [req-f78008a1-7858-4edd-aba7-e089cb161242 req-5f9dd1d7-525c-4904-ac01-2b995a49855f service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Refreshing network info cache for port d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:53 user nova-compute[74540]: DEBUG nova.network.neutron [req-f78008a1-7858-4edd-aba7-e089cb161242 req-5f9dd1d7-525c-4904-ac01-2b995a49855f service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Updated VIF entry in instance network info cache for port d711d258-7e53-4467-93ca-6ed95045095a. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:58:53 user nova-compute[74540]: DEBUG nova.network.neutron [req-f78008a1-7858-4edd-aba7-e089cb161242 req-5f9dd1d7-525c-4904-ac01-2b995a49855f service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Updating instance_info_cache with network_info: [{"id": "d711d258-7e53-4467-93ca-6ed95045095a", "address": "fa:16:3e:06:0d:dc", "network": {"id": "9397df5e-5494-42e9-b228-e6e56895fd13", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1555022831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9165dbae4d9448d6adba10e82cbfc624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd711d258-7e", "ovs_interfaceid": "d711d258-7e53-4467-93ca-6ed95045095a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f78008a1-7858-4edd-aba7-e089cb161242 req-5f9dd1d7-525c-4904-ac01-2b995a49855f service nova] Releasing lock "refresh_cache-8c37887f-4c8a-4808-82a7-f8701dd9b62e" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:58:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:58:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-b410b640-2cc6-4d14-b0fc-f517a5da7582 req-b4d894a7-252c-46af-a29e-fcc480a9dc3c service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Received event network-changed-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:58:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-b410b640-2cc6-4d14-b0fc-f517a5da7582 req-b4d894a7-252c-46af-a29e-fcc480a9dc3c service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Refreshing instance network info cache due to event network-changed-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:58:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b410b640-2cc6-4d14-b0fc-f517a5da7582 req-b4d894a7-252c-46af-a29e-fcc480a9dc3c service nova] Acquiring lock "refresh_cache-5d248eae-ef06-4be3-9178-15d54309be59" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:58:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b410b640-2cc6-4d14-b0fc-f517a5da7582 req-b4d894a7-252c-46af-a29e-fcc480a9dc3c service nova] Acquired lock "refresh_cache-5d248eae-ef06-4be3-9178-15d54309be59" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:58:56 user nova-compute[74540]: DEBUG nova.network.neutron [req-b410b640-2cc6-4d14-b0fc-f517a5da7582 req-b4d894a7-252c-46af-a29e-fcc480a9dc3c service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Refreshing network info cache for port 4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:58:57 user nova-compute[74540]: DEBUG nova.network.neutron [req-b410b640-2cc6-4d14-b0fc-f517a5da7582 req-b4d894a7-252c-46af-a29e-fcc480a9dc3c service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Updated VIF entry in instance network info cache for port 4cbbc3b5-403c-4f1b-84d5-0b520e4eb835. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:58:57 user nova-compute[74540]: DEBUG nova.network.neutron [req-b410b640-2cc6-4d14-b0fc-f517a5da7582 req-b4d894a7-252c-46af-a29e-fcc480a9dc3c service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Updating instance_info_cache with network_info: [{"id": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "address": "fa:16:3e:d8:ff:dc", "network": {"id": "c05abc26-7a24-4c10-8a8a-dc373474d503", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1825825046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740df87a8830417797c8126d81b36377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbbc3b5-40", "ovs_interfaceid": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:58:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b410b640-2cc6-4d14-b0fc-f517a5da7582 req-b4d894a7-252c-46af-a29e-fcc480a9dc3c service nova] Releasing lock "refresh_cache-5d248eae-ef06-4be3-9178-15d54309be59" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:59:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEapSbch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:01 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:01 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:01 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 03:59:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[60325cf3-79ed-45ed-8840-8a2149179858]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 03:59:01 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a6c482-2aa9-40f5-92b1-f96511ddd185]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a] added
Nov 07 03:59:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdf51a7-bf1e-4327-8729-33e35218f4f8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccefff30-8082-4aad-9870-72d6a15a09b2]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nEapSbch {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nEapSbch" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ce4d05-c83f-4177-b653-f8c58d9219c1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nEapSbch'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3722293-e363-40f2-89f4-fc5f8bdfa8f5]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[81194a91-1900-4b8b-9a94-44338a989171]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[611971c0-8c17-44ff-8815-6c89f9588489]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a, portal: 172.16.0.220,3260]
Nov 07 03:59:02 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a, portal: 172.16.0.220,3260] successful.
Nov 07 03:59:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe90631-b858-45d2-b8fa-52618bca7856]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cd0c63-77e3-430d-ac70-84df2b453757]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:02 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:02 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d53c44-b2ec-4cf9-9f68-36863af98b28]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEapSbch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "5d248eae-ef06-4be3-9178-15d54309be59" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "5d248eae-ef06-4be3-9178-15d54309be59" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG nova.objects.instance [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lazy-loading 'flavor' on Instance uuid 5d248eae-ef06-4be3-9178-15d54309be59 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "5d248eae-ef06-4be3-9178-15d54309be59" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:02 user nova-compute[74540]: INFO nova.virt.block_device [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Booting with volume 8a2c4da1-4612-463f-bae7-f82241cdbace at /dev/vdc
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.utils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "5d248eae-ef06-4be3-9178-15d54309be59" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "5d248eae-ef06-4be3-9178-15d54309be59" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:02 user nova-compute[74540]: INFO nova.compute.manager [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Attaching volume bef07b9d-ce1e-4543-abbd-ce125a6830e1 to /dev/vdb
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eacb7b5-712c-409c-a08f-b2a16c091e56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e73f521-c701-4ac7-afb9-519985e1afbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9fa8fa-c7b2-42dc-a4e3-5d46091b7f71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad9dc8b-71b3-46b0-9701-be0df1ed6371]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.utils [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da0f73a-020e-4f5e-85f1-6c72cfe05d04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:03 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c93898-ae02-48fa-b18a-cccee77f651d]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.utils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating existing volume attachment record: d859257c-f49f-4a56-a973-cd0396295dc8 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[971a3b29-9d01-4647-82b2-ea36ce00ebb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[590eac8c-6f71-4bde-a66b-d866455e071c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[471c84d1-5d02-42a8-89b9-c78817e6c4c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:03 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f137269e-0eac-4d81-a056-e00e8a13e651]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.utils [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Updating existing volume attachment record: 70d2808c-d3c7-4d60-bd33-916d69ed2779 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26534353635323664', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534353635323664', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG nova.objects.instance [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'flavor' on Instance uuid d6501f90-9180-4e99-a294-9ffba799c247 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 03:59:03 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 03:59:03 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 03:59:03 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 03:59:03 user nova-compute[74540]:   <serial>3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a</serial>
Nov 07 03:59:03 user nova-compute[74540]: </disk>
Nov 07 03:59:03 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 03:59:03 user nova-compute[74540]: INFO nova.virt.block_device [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Booting with volume 49d04f29-37ec-4d4e-a075-b4423dbff9b4 at /dev/vdc
Nov 07 03:59:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No VIF found with MAC fa:16:3e:5c:97:16, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.utils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2948cdb2-d5af-4db7-b827-d3a7e03779c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4f9b56-f0e0-4745-9d8e-165663d73eed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb87290-ea3a-4924-9cef-25f4edad06b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e832d18-c8d3-4614-ae86-5c8e06e5d055]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:03 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5d014c-4107-41e4-a255-c1baef43526e]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG os_brick.utils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating existing volume attachment record: d71367bc-b191-4861-8692-cff4d82f14fd {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 03:59:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0baacb83-0a4d-4a4e-86df-a48775958b93 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "d6501f90-9180-4e99-a294-9ffba799c247" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.457s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-b663d240-87b3-4250-adba-4d2acd938e7b req-b188b565-362f-446d-9897-4bb79112661b service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Received event network-changed-88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-b663d240-87b3-4250-adba-4d2acd938e7b req-b188b565-362f-446d-9897-4bb79112661b service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Refreshing instance network info cache due to event network-changed-88b714c9-dbce-4852-b4db-914aabf9b148. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:59:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b663d240-87b3-4250-adba-4d2acd938e7b req-b188b565-362f-446d-9897-4bb79112661b service nova] Acquiring lock "refresh_cache-a78e9806-c043-437c-b085-108eee9a921b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:59:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b663d240-87b3-4250-adba-4d2acd938e7b req-b188b565-362f-446d-9897-4bb79112661b service nova] Acquired lock "refresh_cache-a78e9806-c043-437c-b085-108eee9a921b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:59:06 user nova-compute[74540]: DEBUG nova.network.neutron [req-b663d240-87b3-4250-adba-4d2acd938e7b req-b188b565-362f-446d-9897-4bb79112661b service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Refreshing network info cache for port 88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:59:07 user nova-compute[74540]: DEBUG nova.network.neutron [req-b663d240-87b3-4250-adba-4d2acd938e7b req-b188b565-362f-446d-9897-4bb79112661b service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Updated VIF entry in instance network info cache for port 88b714c9-dbce-4852-b4db-914aabf9b148. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:59:07 user nova-compute[74540]: DEBUG nova.network.neutron [req-b663d240-87b3-4250-adba-4d2acd938e7b req-b188b565-362f-446d-9897-4bb79112661b service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Updating instance_info_cache with network_info: [{"id": "88b714c9-dbce-4852-b4db-914aabf9b148", "address": "fa:16:3e:4a:39:9d", "network": {"id": "6476c0b5-57f3-4884-b30b-14a860ab605e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1311869783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f8f90448fc46938fcbd7edd12a33f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b714c9-db", "ovs_interfaceid": "88b714c9-dbce-4852-b4db-914aabf9b148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:59:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b663d240-87b3-4250-adba-4d2acd938e7b req-b188b565-362f-446d-9897-4bb79112661b service nova] Releasing lock "refresh_cache-a78e9806-c043-437c-b085-108eee9a921b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:59:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:59:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:59:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Acquiring lock "a78e9806-c043-437c-b085-108eee9a921b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lock "a78e9806-c043-437c-b085-108eee9a921b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lazy-loading 'flavor' on Instance uuid a78e9806-c043-437c-b085-108eee9a921b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lock "a78e9806-c043-437c-b085-108eee9a921b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:59:27 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Creating image(s)
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Ensure instance console log exists: /opt/stack/data/nova/instances/b0838704-02b2-4591-9d88-fe0dedcd8452/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Start _get_guest_xml network_info=[{"id": "f821c840-d892-434e-a289-affbb1fd08b6", "address": "fa:16:3e:36:80:ce", "network": {"id": "ddefaf54-73f2-48fa-9dd2-1c41aec51746", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1771812249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf821c840-d8", "ovs_interfaceid": "f821c840-d892-434e-a289-affbb1fd08b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "address": "fa:16:3e:22:ac:ce", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10c9e61-e2", "ovs_interfaceid": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAFfKovn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0838704-02b2-4591-9d88-fe0dedcd8452', 'attached_at': '', 'detached_at': '', 'volume_id': '5f2f4e21-0f8d-4d91-aef7-85a52ece7a03', 'serial': '5f2f4e21-0f8d-4d91-aef7-85a52ece7a03'}, 'boot_index': 0, 'attachment_id': 'f6560972-b29a-4207-83a8-27e6d32671ad', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgYBUqZc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0838704-02b2-4591-9d88-fe0dedcd8452', 'attached_at': '', 'detached_at': '', 'volume_id': '9e8ef321-04a2-4d5e-bee1-86329d4edc80', 'serial': '9e8ef321-04a2-4d5e-bee1-86329d4edc80'}, 'boot_index': 1, 'attachment_id': '1cd856d4-5139-448b-8d56-bc311753d494', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXkwaKQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0838704-02b2-4591-9d88-fe0dedcd8452', 'attached_at': '', 'detached_at': '', 'volume_id': '8a2c4da1-4612-463f-bae7-f82241cdbace', 'serial': '8a2c4da1-4612-463f-bae7-f82241cdbace'}, 'boot_index': 2, 'attachment_id': 'd859257c-f49f-4a56-a973-cd0396295dc8', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "6d43f26f-dfbb-4299-b875-f498979679d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:27 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:59:27 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lazy-loading 'flavor' on Instance uuid 6d43f26f-dfbb-4299-b875-f498979679d9 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAFfKovn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:27 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:27 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:27 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "6d43f26f-dfbb-4299-b875-f498979679d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9185c6-e4eb-405a-a9ab-79693fa59344]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 03:59:27 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a33e8e-5672-4721-915f-53e80aebf263]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03] added
Nov 07 03:59:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1216a86-dd49-4ab3-8610-38198324796f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d05097-a0a5-4f75-97a1-688a0dc05448]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GAFfKovn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GAFfKovn" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[397e04bb-f68c-48e3-b65d-eb35e1cc9b23]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GAFfKovn'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3035ad4e-c2f6-4a50-8ba8-3845b59611a3]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG nova.objects.instance [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lazy-loading 'flavor' on Instance uuid 8c37887f-4c8a-4808-82a7-f8701dd9b62e {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bad7fc-e910-4732-b511-418bc2d5d1ee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:27 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:27 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec5e688-c615-4149-8d0d-0a37f512da5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03, portal: 172.16.0.220,3260]
Nov 07 03:59:27 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03, portal: 172.16.0.220,3260] successful.
Nov 07 03:59:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d634bc-f048-42d0-afcd-21609370b84a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Acquiring lock "a78e9806-c043-437c-b085-108eee9a921b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lock "a78e9806-c043-437c-b085-108eee9a921b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:27 user nova-compute[74540]: INFO nova.compute.manager [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] [instance: a78e9806-c043-437c-b085-108eee9a921b] Attaching volume e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 to /dev/vdb
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba55d8d-803a-48d2-961a-bed1eb969a65]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:27 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:27 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:27 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:27 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b852070-2fec-42e0-9cb5-2e50f7232b7a]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAFfKovn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "6d43f26f-dfbb-4299-b875-f498979679d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:27 user nova-compute[74540]: INFO nova.compute.manager [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Attaching volume a0a4e5cd-6c7f-4099-bca6-84607868ca76 to /dev/vdb
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:28 user nova-compute[74540]: INFO nova.compute.manager [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Attaching volume 45ae65cc-97a4-4886-8c5f-e641f99dea1f to /dev/sdc
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.utils [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a571df0-0366-41ed-a02f-0c006fbdb030]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5ce673-32d7-4ff8-afe7-e2d234878fbf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c35681-f54f-444e-8941-5d70378d8dd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe2159d-4a2f-4d05-950c-68ce76032c99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.utils [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:28 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21f05df-489c-4aa3-a620-3b395fbf45f3]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.utils [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] [instance: a78e9806-c043-437c-b085-108eee9a921b] Updating existing volume attachment record: 01961380-f044-4ad3-8f90-69fb633a4c85 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7badb8a6-1c54-4010-b907-7921d6414f72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[665c58ab-8d4a-4f15-b9ec-1fac71614858]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab83d53b-1a72-44b7-902e-10892004ceb2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1859f7fa-0e22-4c7e-93d1-431ee8300536]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.utils [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b5743d-9c8c-4472-a6b7-27e05664da74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:28 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeb9a01-295d-4b03-9216-19d9d4384a19]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.utils [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Updating existing volume attachment record: d1c56f8d-6375-438b-9e38-813f28cbb20b {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[15473d89-ca1a-44f4-8113-7ba6246b9944]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[561e5605-d603-422a-a626-59876bb72183]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[832c6b6d-dc0b-4434-a960-608bd7d8a90e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:28 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[56048492-c313-4553-afc1-a7edac32bae8]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.utils [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Updating existing volume attachment record: 5bf364cf-7ddd-40c6-a53d-66bb68543c32 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26366646261336534', 'path': '/dev/sdd'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366646261336534', 'path': '/dev/sdd'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgYBUqZc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:28 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:28 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:28 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 03:59:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4d979e-79db-444c-94d3-3915b3db2536]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 03:59:29 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd8749f-b624-49cc-b2da-f451f86e296e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80] added
Nov 07 03:59:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eac4e0e-829a-4c9a-931f-f1914961756d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb7fd50-939f-44e5-a0bd-837273299338]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgYBUqZc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgYBUqZc" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e2a4b5-cbe8-4d00-94ed-44290b08677a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QgYBUqZc'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ad188d-3e06-44a2-9412-9f44cb207651]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2233802d-cc93-44e5-84ba-8c8a120a2ca2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:29 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:29 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:29 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:29 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee966029-c8aa-4628-b126-3a5d9e8d3c87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80, portal: 172.16.0.220,3260]
Nov 07 03:59:29 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80, portal: 172.16.0.220,3260] successful.
Nov 07 03:59:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff7c439-7934-43fc-bd08-97943e08b8be]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee6e9d1-7bf3-4fde-82c3-25bc2ba50731]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:29 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:29 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:29 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:29 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:29 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:29 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddddb88-5ed1-4e1c-b899-ad7aca8f304f]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgYBUqZc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:59:29 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23162623961626563', 'path': '/dev/sde'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162623961626563', 'path': '/dev/sde'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXkwaKQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:30 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:30 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:30 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 03:59:30 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updating instance_info_cache with network_info: [{"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a734d8c-dd52-4345-9547-27f4c72bb743]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 03:59:30 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a4bfff-aabe-4b41-8401-8394e3e2495f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace] added
Nov 07 03:59:30 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d954f09c-2671-4986-82bc-1bf456f44629]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0375fcfd-6e97-45a0-9d87-9313e04f8934]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZXkwaKQh {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZXkwaKQh" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fa5aca-8f8c-40a7-a785-54097a182976]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZXkwaKQh'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d0692d-bbe5-42a0-8f80-17da14153278]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5f73ac-7c78-4157-a2d3-ae2cc5c8a2c3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:30 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:30 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e317b24d-e4f8-45e5-920e-0583617d8e58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace, portal: 172.16.0.220,3260]
Nov 07 03:59:30 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace, portal: 172.16.0.220,3260] successful.
Nov 07 03:59:30 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a11466-f50d-4637-b606-24f13f22ed4a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36744e7-e5d9-41d1-a9e1-77581f11083e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:30 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:30 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:30 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8636c7a-8d26-42da-969c-c1628aedf649]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXkwaKQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "6679686b-b418-41ce-a160-97ec9df754c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "6679686b-b418-41ce-a160-97ec9df754c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.523s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 03:59:31 user nova-compute[74540]: INFO nova.compute.claims [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Claim successful on node user
Nov 07 03:59:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23130396165613137', 'path': '/dev/sdf'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130396165613137', 'path': '/dev/sdf'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f821c840-d892-434e-a289-affbb1fd08b6", "address": "fa:16:3e:36:80:ce", "network": {"id": "ddefaf54-73f2-48fa-9dd2-1c41aec51746", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1771812249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf821c840-d8", "ovs_interfaceid": "f821c840-d892-434e-a289-affbb1fd08b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "f821c840-d892-434e-a289-affbb1fd08b6", "address": "fa:16:3e:36:80:ce", "network": {"id": "ddefaf54-73f2-48fa-9dd2-1c41aec51746", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1771812249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf821c840-d8", "ovs_interfaceid": "f821c840-d892-434e-a289-affbb1fd08b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=f821c840-d892-434e-a289-affbb1fd08b6,network=Network(ddefaf54-73f2-48fa-9dd2-1c41aec51746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf821c840-d8') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ba:2d,bridge_name='br-int',has_traffic_filtering=True,id=a0750b9d-bbac-490f-af0f-f4ca13768c3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0750b9d-bb') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:10:3d,bridge_name='br-int',has_traffic_filtering=True,id=b211e9e5-243c-481c-bfef-6b3a9c532a3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb211e9e5-24') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:54,bridge_name='br-int',has_traffic_filtering=True,id=b806d809-0e35-4345-8665-d3e15ad73b59,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806d809-0e') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=9254f39e-f860-47d2-b274-12d409c79d83,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9254f39e-f8') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "address": "fa:16:3e:22:ac:ce", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10c9e61-e2", "ovs_interfaceid": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "address": "fa:16:3e:22:ac:ce", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10c9e61-e2", "ovs_interfaceid": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=f10c9e61-e28f-4432-b85e-a91c1a205b1a,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10c9e61-e2') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:c1:4b,bridge_name='br-int',has_traffic_filtering=True,id=18407b84-616b-4e09-98f0-1fe082ecd8ec,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18407b84-61') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.objects.instance [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lazy-loading 'pci_devices' on Instance uuid b0838704-02b2-4591-9d88-fe0dedcd8452 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:59:31 user nova-compute[74540]:   <uuid>b0838704-02b2-4591-9d88-fe0dedcd8452</uuid>
Nov 07 03:59:31 user nova-compute[74540]:   <name>instance-0000000b</name>
Nov 07 03:59:31 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:59:31 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:59:31 user nova-compute[74540]:   <metadata>
Nov 07 03:59:31 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:59:31 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:59:31 user nova-compute[74540]:       <nova:name>tempest-device-tagging-server-562296522</nova:name>
Nov 07 03:59:31 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:59:27</nova:creationTime>
Nov 07 03:59:31 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:59:31 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:59:31 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:59:31 user nova-compute[74540]:       <nova:owner>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:user uuid="8307342a3838409c842e44cdea7d9e79">tempest-TaggedBootDevicesTest-1787786945-project-member</nova:user>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:project uuid="663e196e8d464d188e5e5dfbf8965da7">tempest-TaggedBootDevicesTest-1787786945</nova:project>
Nov 07 03:59:31 user nova-compute[74540]:       </nova:owner>
Nov 07 03:59:31 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 03:59:31 user nova-compute[74540]:       <nova:ports>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:port uuid="f821c840-d892-434e-a289-affbb1fd08b6">
Nov 07 03:59:31 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 03:59:31 user nova-compute[74540]:         </nova:port>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:port uuid="a0750b9d-bbac-490f-af0f-f4ca13768c3c">
Nov 07 03:59:31 user nova-compute[74540]:           <nova:ip type="fixed" address="10.1.1.140" ipVersion="4"/>
Nov 07 03:59:31 user nova-compute[74540]:         </nova:port>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:port uuid="b211e9e5-243c-481c-bfef-6b3a9c532a3c">
Nov 07 03:59:31 user nova-compute[74540]:           <nova:ip type="fixed" address="10.1.1.98" ipVersion="4"/>
Nov 07 03:59:31 user nova-compute[74540]:         </nova:port>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:port uuid="b806d809-0e35-4345-8665-d3e15ad73b59">
Nov 07 03:59:31 user nova-compute[74540]:           <nova:ip type="fixed" address="10.1.1.148" ipVersion="4"/>
Nov 07 03:59:31 user nova-compute[74540]:         </nova:port>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:port uuid="9254f39e-f860-47d2-b274-12d409c79d83">
Nov 07 03:59:31 user nova-compute[74540]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Nov 07 03:59:31 user nova-compute[74540]:         </nova:port>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:port uuid="f10c9e61-e28f-4432-b85e-a91c1a205b1a">
Nov 07 03:59:31 user nova-compute[74540]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 07 03:59:31 user nova-compute[74540]:         </nova:port>
Nov 07 03:59:31 user nova-compute[74540]:         <nova:port uuid="18407b84-616b-4e09-98f0-1fe082ecd8ec">
Nov 07 03:59:31 user nova-compute[74540]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 07 03:59:31 user nova-compute[74540]:         </nova:port>
Nov 07 03:59:31 user nova-compute[74540]:       </nova:ports>
Nov 07 03:59:31 user nova-compute[74540]:     </nova:instance>
Nov 07 03:59:31 user nova-compute[74540]:   </metadata>
Nov 07 03:59:31 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:59:31 user nova-compute[74540]:     <system>
Nov 07 03:59:31 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:59:31 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:59:31 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:59:31 user nova-compute[74540]:       <entry name="serial">b0838704-02b2-4591-9d88-fe0dedcd8452</entry>
Nov 07 03:59:31 user nova-compute[74540]:       <entry name="uuid">b0838704-02b2-4591-9d88-fe0dedcd8452</entry>
Nov 07 03:59:31 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:59:31 user nova-compute[74540]:     </system>
Nov 07 03:59:31 user nova-compute[74540]:   </sysinfo>
Nov 07 03:59:31 user nova-compute[74540]:   <os>
Nov 07 03:59:31 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:59:31 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 03:59:31 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:59:31 user nova-compute[74540]:   </os>
Nov 07 03:59:31 user nova-compute[74540]:   <features>
Nov 07 03:59:31 user nova-compute[74540]:     <acpi/>
Nov 07 03:59:31 user nova-compute[74540]:     <apic/>
Nov 07 03:59:31 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:59:31 user nova-compute[74540]:   </features>
Nov 07 03:59:31 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:59:31 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:59:31 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:59:31 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:59:31 user nova-compute[74540]:   </clock>
Nov 07 03:59:31 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:59:31 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:59:31 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:59:31 user nova-compute[74540]:   </cpu>
Nov 07 03:59:31 user nova-compute[74540]:   <devices>
Nov 07 03:59:31 user nova-compute[74540]:     <disk type="file" device="cdrom">
Nov 07 03:59:31 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none"/>
Nov 07 03:59:31 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/b0838704-02b2-4591-9d88-fe0dedcd8452/disk.config"/>
Nov 07 03:59:31 user nova-compute[74540]:       <target dev="hda" bus="ide"/>
Nov 07 03:59:31 user nova-compute[74540]:     </disk>
Nov 07 03:59:31 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 03:59:31 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 03:59:31 user nova-compute[74540]:       <source dev="/dev/sdd"/>
Nov 07 03:59:31 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 03:59:31 user nova-compute[74540]:       <serial>5f2f4e21-0f8d-4d91-aef7-85a52ece7a03</serial>
Nov 07 03:59:31 user nova-compute[74540]:     </disk>
Nov 07 03:59:31 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 03:59:31 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 03:59:31 user nova-compute[74540]:       <source dev="/dev/sde"/>
Nov 07 03:59:31 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 03:59:31 user nova-compute[74540]:       <serial>9e8ef321-04a2-4d5e-bee1-86329d4edc80</serial>
Nov 07 03:59:31 user nova-compute[74540]:     </disk>
Nov 07 03:59:31 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 03:59:31 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 03:59:31 user nova-compute[74540]:       <source dev="/dev/sdf"/>
Nov 07 03:59:31 user nova-compute[74540]:       <target dev="vdc" bus="virtio"/>
Nov 07 03:59:31 user nova-compute[74540]:       <serial>8a2c4da1-4612-463f-bae7-f82241cdbace</serial>
Nov 07 03:59:31 user nova-compute[74540]:     </disk>
Nov 07 03:59:31 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:59:31 user nova-compute[74540]:       <mac address="fa:16:3e:36:80:ce"/>
Nov 07 03:59:31 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:59:31 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:59:31 user nova-compute[74540]:       <target dev="tapf821c840-d8"/>
Nov 07 03:59:31 user nova-compute[74540]:     </interface>
Nov 07 03:59:31 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:59:31 user nova-compute[74540]:       <mac address="fa:16:3e:43:ba:2d"/>
Nov 07 03:59:31 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:59:31 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:59:31 user nova-compute[74540]:       <target dev="tapa0750b9d-bb"/>
Nov 07 03:59:31 user nova-compute[74540]:     </interface>
Nov 07 03:59:31 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:59:31 user nova-compute[74540]:       <mac address="fa:16:3e:42:10:3d"/>
Nov 07 03:59:31 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:59:31 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:59:31 user nova-compute[74540]:       <target dev="tapb211e9e5-24"/>
Nov 07 03:59:31 user nova-compute[74540]:     </interface>
Nov 07 03:59:31 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:59:31 user nova-compute[74540]:       <mac address="fa:16:3e:10:54:54"/>
Nov 07 03:59:31 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:59:31 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:59:31 user nova-compute[74540]:       <target dev="tapb806d809-0e"/>
Nov 07 03:59:31 user nova-compute[74540]:     </interface>
Nov 07 03:59:31 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:59:31 user nova-compute[74540]:       <mac address="fa:16:3e:93:4d:2d"/>
Nov 07 03:59:31 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:59:31 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:59:31 user nova-compute[74540]:       <target dev="tap9254f39e-f8"/>
Nov 07 03:59:31 user nova-compute[74540]:     </interface>
Nov 07 03:59:31 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:59:31 user nova-compute[74540]:       <mac address="fa:16:3e:22:ac:ce"/>
Nov 07 03:59:31 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:59:31 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:59:31 user nova-compute[74540]:       <target dev="tapf10c9e61-e2"/>
Nov 07 03:59:31 user nova-compute[74540]:     </interface>
Nov 07 03:59:31 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:59:31 user nova-compute[74540]:       <mac address="fa:16:3e:ea:c1:4b"/>
Nov 07 03:59:31 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:59:31 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:59:31 user nova-compute[74540]:       <target dev="tap18407b84-61"/>
Nov 07 03:59:31 user nova-compute[74540]:     </interface>
Nov 07 03:59:31 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:59:31 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/b0838704-02b2-4591-9d88-fe0dedcd8452/console.log" append="off"/>
Nov 07 03:59:31 user nova-compute[74540]:     </serial>
Nov 07 03:59:31 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:59:31 user nova-compute[74540]:     <video>
Nov 07 03:59:31 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:59:31 user nova-compute[74540]:     </video>
Nov 07 03:59:31 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:59:31 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:59:31 user nova-compute[74540]:     </rng>
Nov 07 03:59:31 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:59:31 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:59:31 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:59:31 user nova-compute[74540]:     </memballoon>
Nov 07 03:59:31 user nova-compute[74540]:   </devices>
Nov 07 03:59:31 user nova-compute[74540]: </domain>
Nov 07 03:59:31 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f821c840-d892-434e-a289-affbb1fd08b6", "address": "fa:16:3e:36:80:ce", "network": {"id": "ddefaf54-73f2-48fa-9dd2-1c41aec51746", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1771812249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf821c840-d8", "ovs_interfaceid": "f821c840-d892-434e-a289-affbb1fd08b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "f821c840-d892-434e-a289-affbb1fd08b6", "address": "fa:16:3e:36:80:ce", "network": {"id": "ddefaf54-73f2-48fa-9dd2-1c41aec51746", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1771812249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf821c840-d8", "ovs_interfaceid": "f821c840-d892-434e-a289-affbb1fd08b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=f821c840-d892-434e-a289-affbb1fd08b6,network=Network(ddefaf54-73f2-48fa-9dd2-1c41aec51746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf821c840-d8') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=f821c840-d892-434e-a289-affbb1fd08b6,network=Network(ddefaf54-73f2-48fa-9dd2-1c41aec51746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf821c840-d8') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f7c1afc-cf1e-5e2e-bf68-bbbaf86093f8', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf821c840-d8, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf821c840-d8, col_values=(('qos', UUID('498fe82b-8df8-4894-8d4f-d6cdbaa11b54')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf821c840-d8, col_values=(('external_ids', {'iface-id': 'f821c840-d892-434e-a289-affbb1fd08b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:80:ce', 'vm-uuid': 'b0838704-02b2-4591-9d88-fe0dedcd8452'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: INFO os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=f821c840-d892-434e-a289-affbb1fd08b6,network=Network(ddefaf54-73f2-48fa-9dd2-1c41aec51746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf821c840-d8')
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ba:2d,bridge_name='br-int',has_traffic_filtering=True,id=a0750b9d-bbac-490f-af0f-f4ca13768c3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0750b9d-bb') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ba:2d,bridge_name='br-int',has_traffic_filtering=True,id=a0750b9d-bbac-490f-af0f-f4ca13768c3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0750b9d-bb') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a91b939-e427-5a94-84f1-899b437700b9', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0750b9d-bb, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0750b9d-bb, col_values=(('qos', UUID('a76f6181-b33b-4e36-9dff-9e95e848cd88')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0750b9d-bb, col_values=(('external_ids', {'iface-id': 'a0750b9d-bbac-490f-af0f-f4ca13768c3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:ba:2d', 'vm-uuid': 'b0838704-02b2-4591-9d88-fe0dedcd8452'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: INFO os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ba:2d,bridge_name='br-int',has_traffic_filtering=True,id=a0750b9d-bbac-490f-af0f-f4ca13768c3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0750b9d-bb')
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:10:3d,bridge_name='br-int',has_traffic_filtering=True,id=b211e9e5-243c-481c-bfef-6b3a9c532a3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb211e9e5-24') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:10:3d,bridge_name='br-int',has_traffic_filtering=True,id=b211e9e5-243c-481c-bfef-6b3a9c532a3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb211e9e5-24') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2587f857-6eba-5ac0-a15c-36d48ab62cd0', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb211e9e5-24, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb211e9e5-24, col_values=(('qos', UUID('66950c7c-0b81-4d0e-bd9e-0d92683f9374')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb211e9e5-24, col_values=(('external_ids', {'iface-id': 'b211e9e5-243c-481c-bfef-6b3a9c532a3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:10:3d', 'vm-uuid': 'b0838704-02b2-4591-9d88-fe0dedcd8452'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCfRSmPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:32 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:32 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:32 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: INFO os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:10:3d,bridge_name='br-int',has_traffic_filtering=True,id=b211e9e5-243c-481c-bfef-6b3a9c532a3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb211e9e5-24')
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:54,bridge_name='br-int',has_traffic_filtering=True,id=b806d809-0e35-4345-8665-d3e15ad73b59,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806d809-0e') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:54,bridge_name='br-int',has_traffic_filtering=True,id=b806d809-0e35-4345-8665-d3e15ad73b59,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806d809-0e') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44ecf88-9196-4263-b7ef-a444119939f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e874604c-dbdd-5929-bdcc-0a8a1802090a', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 03:59:32 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c9705e-b601-44b4-9ba3-da8f8a419c0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1] added
Nov 07 03:59:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb806d809-0e, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb806d809-0e, col_values=(('qos', UUID('d770c119-acd2-4b62-a7c0-31a737162de8')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb806d809-0e, col_values=(('external_ids', {'iface-id': 'b806d809-0e35-4345-8665-d3e15ad73b59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:54:54', 'vm-uuid': 'b0838704-02b2-4591-9d88-fe0dedcd8452'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1178e162-4dc7-4bf7-8c80-c81aaa0ed7f2]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d997f230-21f2-4384-bab6-3ea2828e302d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:32 user nova-compute[74540]: INFO os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:54,bridge_name='br-int',has_traffic_filtering=True,id=b806d809-0e35-4345-8665-d3e15ad73b59,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806d809-0e')
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=9254f39e-f860-47d2-b274-12d409c79d83,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9254f39e-f8') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=9254f39e-f860-47d2-b274-12d409c79d83,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9254f39e-f8') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCfRSmPK {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8fd95f1-2a8c-5130-9908-2e1d469c99b2', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCfRSmPK" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a631e7-3eb1-4621-bdac-0c5d45747a03]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OCfRSmPK'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7944a89e-4bf2-40ae-a1cc-300317b5a46f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9254f39e-f8, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9254f39e-f8, col_values=(('qos', UUID('0f65167f-eaac-4d8d-92ee-de138baf8577')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9254f39e-f8, col_values=(('external_ids', {'iface-id': '9254f39e-f860-47d2-b274-12d409c79d83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:4d:2d', 'vm-uuid': 'b0838704-02b2-4591-9d88-fe0dedcd8452'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f915b2-7052-4ac7-bb66-21da70542faf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: INFO os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=9254f39e-f860-47d2-b274-12d409c79d83,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9254f39e-f8')
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "address": "fa:16:3e:22:ac:ce", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10c9e61-e2", "ovs_interfaceid": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "address": "fa:16:3e:22:ac:ce", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10c9e61-e2", "ovs_interfaceid": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=f10c9e61-e28f-4432-b85e-a91c1a205b1a,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10c9e61-e2') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=f10c9e61-e28f-4432-b85e-a91c1a205b1a,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10c9e61-e2') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7249c208-4355-52d2-9c06-df138156ee64', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7375bd03-8f17-42fe-afbb-52eafde2aee7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.864s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260]
Nov 07 03:59:32 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260] successful.
Nov 07 03:59:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf10c9e61-e2, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf10c9e61-e2, col_values=(('qos', UUID('bf96937c-4e58-494f-a9b7-a6ab1cad6f42')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf10c9e61-e2, col_values=(('external_ids', {'iface-id': 'f10c9e61-e28f-4432-b85e-a91c1a205b1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:ac:ce', 'vm-uuid': 'b0838704-02b2-4591-9d88-fe0dedcd8452'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b614b10-0e66-4b8f-8c5a-668a55aa3083]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e2d56c-f530-441a-8285-62f7062106f4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:32 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 03:59:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 03:59:32 user nova-compute[74540]: INFO os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=f10c9e61-e28f-4432-b85e-a91c1a205b1a,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10c9e61-e2')
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:c1:4b,bridge_name='br-int',has_traffic_filtering=True,id=18407b84-616b-4e09-98f0-1fe082ecd8ec,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18407b84-61') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:c1:4b,bridge_name='br-int',has_traffic_filtering=True,id=18407b84-616b-4e09-98f0-1fe082ecd8ec,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18407b84-61') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcf97be-9d14-449c-8999-4c46a0cd01e6]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27011e8c-f96c-5d7a-a1e0-a33f651f7d60', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCfRSmPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18407b84-61, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18407b84-61, col_values=(('qos', UUID('d975e80b-fb98-4bff-a52d-773a3a27d59b')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18407b84-61, col_values=(('external_ids', {'iface-id': '18407b84-616b-4e09-98f0-1fe082ecd8ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:c1:4b', 'vm-uuid': 'b0838704-02b2-4591-9d88-fe0dedcd8452'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.policy [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3079ba3a84ea4b4bb4a3e576ab4133ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620cefdadcec49d6a696aa7db8cef2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:32 user nova-compute[74540]: INFO os_vif [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:c1:4b,bridge_name='br-int',has_traffic_filtering=True,id=18407b84-616b-4e09-98f0-1fe082ecd8ec,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18407b84-61')
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:59:32 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Creating image(s)
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "/opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "/opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "/opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] No BDM found with device name hda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] No VIF found with MAC fa:16:3e:36:80:ce, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] No VIF found with MAC fa:16:3e:93:4d:2d, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:59:32 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Using config drive
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.201s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.174s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk 1073741824" returned: 0 in 0.062s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:33 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Creating config drive at /opt/stack/data/nova/instances/b0838704-02b2-4591-9d88-fe0dedcd8452/disk.config
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b0838704-02b2-4591-9d88-fe0dedcd8452/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpp65c2hak {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.206s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b0838704-02b2-4591-9d88-fe0dedcd8452/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpp65c2hak" returned: 0 in 0.093s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Successfully created port: 2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.514s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] <== connect_volume: return (1517ms) {'type': 'block', 'scsi_wwn': '23337303335366331', 'path': '/dev/sdg'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337303335366331', 'path': '/dev/sdg'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Cannot resize image /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Ensure instance console log exists: /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG nova.objects.instance [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lazy-loading 'flavor' on Instance uuid 5d248eae-ef06-4be3-9178-15d54309be59 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 03:59:33 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 03:59:33 user nova-compute[74540]:   <source dev="/dev/sdg"/>
Nov 07 03:59:33 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 03:59:33 user nova-compute[74540]:   <serial>bef07b9d-ce1e-4543-abbd-ce125a6830e1</serial>
Nov 07 03:59:33 user nova-compute[74540]: </disk>
Nov 07 03:59:33 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Successfully updated port: 2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "refresh_cache-6679686b-b418-41ce-a160-97ec9df754c7" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquired lock "refresh_cache-6679686b-b418-41ce-a160-97ec9df754c7" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.compute.manager [req-d2a8d6f2-9ef6-4f74-b790-d854df95e4cd req-c0e4611d-b799-4f58-b356-3b41670f0242 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Received event network-changed-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.compute.manager [req-d2a8d6f2-9ef6-4f74-b790-d854df95e4cd req-c0e4611d-b799-4f58-b356-3b41670f0242 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Refreshing instance network info cache due to event network-changed-2531d2c8-bb10-4e14-a52b-7d7a5ec43153. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d2a8d6f2-9ef6-4f74-b790-d854df95e4cd req-c0e4611d-b799-4f58-b356-3b41670f0242 service nova] Acquiring lock "refresh_cache-6679686b-b418-41ce-a160-97ec9df754c7" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Updating instance_info_cache with network_info: [{"id": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "address": "fa:16:3e:48:14:19", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2531d2c8-bb", "ovs_interfaceid": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Releasing lock "refresh_cache-6679686b-b418-41ce-a160-97ec9df754c7" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Instance network_info: |[{"id": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "address": "fa:16:3e:48:14:19", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2531d2c8-bb", "ovs_interfaceid": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d2a8d6f2-9ef6-4f74-b790-d854df95e4cd req-c0e4611d-b799-4f58-b356-3b41670f0242 service nova] Acquired lock "refresh_cache-6679686b-b418-41ce-a160-97ec9df754c7" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.network.neutron [req-d2a8d6f2-9ef6-4f74-b790-d854df95e4cd req-c0e4611d-b799-4f58-b356-3b41670f0242 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Refreshing network info cache for port 2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Start _get_guest_xml network_info=[{"id": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "address": "fa:16:3e:48:14:19", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2531d2c8-bb", "ovs_interfaceid": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:34 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:59:34 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1673303651',display_name='tempest-AttachVolumeNegativeTest-server-1673303651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1673303651',id=13,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF449I8qlQ3RJxhVgMTFsuiId0RBd22GExYKYlS/zqasFyMqY6v+2Q8x45Pi1ASOTTNMC1EHuLB2yB5jQu0pyavH9SoL9QzwQSMb0nVURc9u7MaYdrSoraP760KJHICDzw==',key_name='tempest-keypair-489856462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='620cefdadcec49d6a696aa7db8cef2d1',ramdisk_id='',reservation_id='r-5rgot3uv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-306463361',owner_user_name='tempest-AttachVolumeNegativeTest-306463361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3079ba3a84ea4b4bb4a3e576ab4133ae',uuid=6679686b-b418-41ce-a160-97ec9df754c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "address": "fa:16:3e:48:14:19", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2531d2c8-bb", "ovs_interfaceid": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converting VIF {"id": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "address": "fa:16:3e:48:14:19", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2531d2c8-bb", "ovs_interfaceid": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:14:19,bridge_name='br-int',has_traffic_filtering=True,id=2531d2c8-bb10-4e14-a52b-7d7a5ec43153,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2531d2c8-bb') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'pci_devices' on Instance uuid 6679686b-b418-41ce-a160-97ec9df754c7 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] No VIF found with MAC fa:16:3e:d8:ff:dc, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] End _get_guest_xml xml=<domain type="kvm">
Nov 07 03:59:34 user nova-compute[74540]:   <uuid>6679686b-b418-41ce-a160-97ec9df754c7</uuid>
Nov 07 03:59:34 user nova-compute[74540]:   <name>instance-0000000d</name>
Nov 07 03:59:34 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 03:59:34 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 03:59:34 user nova-compute[74540]:   <metadata>
Nov 07 03:59:34 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 03:59:34 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 03:59:34 user nova-compute[74540]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1673303651</nova:name>
Nov 07 03:59:34 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:59:34</nova:creationTime>
Nov 07 03:59:34 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 03:59:34 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 03:59:34 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 03:59:34 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 03:59:34 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 03:59:34 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 03:59:34 user nova-compute[74540]:       </nova:flavor>
Nov 07 03:59:34 user nova-compute[74540]:       <nova:owner>
Nov 07 03:59:34 user nova-compute[74540]:         <nova:user uuid="3079ba3a84ea4b4bb4a3e576ab4133ae">tempest-AttachVolumeNegativeTest-306463361-project-member</nova:user>
Nov 07 03:59:34 user nova-compute[74540]:         <nova:project uuid="620cefdadcec49d6a696aa7db8cef2d1">tempest-AttachVolumeNegativeTest-306463361</nova:project>
Nov 07 03:59:34 user nova-compute[74540]:       </nova:owner>
Nov 07 03:59:34 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 03:59:34 user nova-compute[74540]:       <nova:ports>
Nov 07 03:59:34 user nova-compute[74540]:         <nova:port uuid="2531d2c8-bb10-4e14-a52b-7d7a5ec43153">
Nov 07 03:59:34 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 07 03:59:34 user nova-compute[74540]:         </nova:port>
Nov 07 03:59:34 user nova-compute[74540]:       </nova:ports>
Nov 07 03:59:34 user nova-compute[74540]:     </nova:instance>
Nov 07 03:59:34 user nova-compute[74540]:   </metadata>
Nov 07 03:59:34 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 03:59:34 user nova-compute[74540]:     <system>
Nov 07 03:59:34 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 03:59:34 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 03:59:34 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 03:59:34 user nova-compute[74540]:       <entry name="serial">6679686b-b418-41ce-a160-97ec9df754c7</entry>
Nov 07 03:59:34 user nova-compute[74540]:       <entry name="uuid">6679686b-b418-41ce-a160-97ec9df754c7</entry>
Nov 07 03:59:34 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 03:59:34 user nova-compute[74540]:     </system>
Nov 07 03:59:34 user nova-compute[74540]:   </sysinfo>
Nov 07 03:59:34 user nova-compute[74540]:   <os>
Nov 07 03:59:34 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 03:59:34 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 03:59:34 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 03:59:34 user nova-compute[74540]:   </os>
Nov 07 03:59:34 user nova-compute[74540]:   <features>
Nov 07 03:59:34 user nova-compute[74540]:     <acpi/>
Nov 07 03:59:34 user nova-compute[74540]:     <apic/>
Nov 07 03:59:34 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 03:59:34 user nova-compute[74540]:   </features>
Nov 07 03:59:34 user nova-compute[74540]:   <clock offset="utc">
Nov 07 03:59:34 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 03:59:34 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 03:59:34 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 03:59:34 user nova-compute[74540]:   </clock>
Nov 07 03:59:34 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 03:59:34 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 03:59:34 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 03:59:34 user nova-compute[74540]:   </cpu>
Nov 07 03:59:34 user nova-compute[74540]:   <devices>
Nov 07 03:59:34 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 03:59:34 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 03:59:34 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk"/>
Nov 07 03:59:34 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 03:59:34 user nova-compute[74540]:     </disk>
Nov 07 03:59:34 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 03:59:34 user nova-compute[74540]:       <mac address="fa:16:3e:48:14:19"/>
Nov 07 03:59:34 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:59:34 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 03:59:34 user nova-compute[74540]:       <target dev="tap2531d2c8-bb"/>
Nov 07 03:59:34 user nova-compute[74540]:     </interface>
Nov 07 03:59:34 user nova-compute[74540]:     <serial type="pty">
Nov 07 03:59:34 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/console.log" append="off"/>
Nov 07 03:59:34 user nova-compute[74540]:     </serial>
Nov 07 03:59:34 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 03:59:34 user nova-compute[74540]:     <video>
Nov 07 03:59:34 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 03:59:34 user nova-compute[74540]:     </video>
Nov 07 03:59:34 user nova-compute[74540]:     <rng model="virtio">
Nov 07 03:59:34 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 03:59:34 user nova-compute[74540]:     </rng>
Nov 07 03:59:34 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 03:59:34 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 03:59:34 user nova-compute[74540]:       <stats period="10"/>
Nov 07 03:59:34 user nova-compute[74540]:     </memballoon>
Nov 07 03:59:34 user nova-compute[74540]:   </devices>
Nov 07 03:59:34 user nova-compute[74540]: </domain>
Nov 07 03:59:34 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1673303651',display_name='tempest-AttachVolumeNegativeTest-server-1673303651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1673303651',id=13,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF449I8qlQ3RJxhVgMTFsuiId0RBd22GExYKYlS/zqasFyMqY6v+2Q8x45Pi1ASOTTNMC1EHuLB2yB5jQu0pyavH9SoL9QzwQSMb0nVURc9u7MaYdrSoraP760KJHICDzw==',key_name='tempest-keypair-489856462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='620cefdadcec49d6a696aa7db8cef2d1',ramdisk_id='',reservation_id='r-5rgot3uv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-306463361',owner_user_name='tempest-AttachVolumeNegativeTest-306463361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3079ba3a84ea4b4bb4a3e576ab4133ae',uuid=6679686b-b418-41ce-a160-97ec9df754c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "address": "fa:16:3e:48:14:19", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2531d2c8-bb", "ovs_interfaceid": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converting VIF {"id": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "address": "fa:16:3e:48:14:19", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2531d2c8-bb", "ovs_interfaceid": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:14:19,bridge_name='br-int',has_traffic_filtering=True,id=2531d2c8-bb10-4e14-a52b-7d7a5ec43153,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2531d2c8-bb') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG os_vif [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:14:19,bridge_name='br-int',has_traffic_filtering=True,id=2531d2c8-bb10-4e14-a52b-7d7a5ec43153,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2531d2c8-bb') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f146435-658b-5080-b33d-6a330ae1de07', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2531d2c8-bb, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2531d2c8-bb, col_values=(('qos', UUID('b3931273-c6ab-4f4a-bc5f-080bee7e207b')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2531d2c8-bb, col_values=(('external_ids', {'iface-id': '2531d2c8-bb10-4e14-a52b-7d7a5ec43153', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:14:19', 'vm-uuid': '6679686b-b418-41ce-a160-97ec9df754c7'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:34 user nova-compute[74540]: INFO os_vif [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:14:19,bridge_name='br-int',has_traffic_filtering=True,id=2531d2c8-bb10-4e14-a52b-7d7a5ec43153,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2531d2c8-bb')
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No VIF found with MAC fa:16:3e:48:14:19, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:59:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:35 user nova-compute[74540]: DEBUG nova.network.neutron [req-d2a8d6f2-9ef6-4f74-b790-d854df95e4cd req-c0e4611d-b799-4f58-b356-3b41670f0242 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Updated VIF entry in instance network info cache for port 2531d2c8-bb10-4e14-a52b-7d7a5ec43153. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:59:35 user nova-compute[74540]: DEBUG nova.network.neutron [req-d2a8d6f2-9ef6-4f74-b790-d854df95e4cd req-c0e4611d-b799-4f58-b356-3b41670f0242 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Updating instance_info_cache with network_info: [{"id": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "address": "fa:16:3e:48:14:19", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2531d2c8-bb", "ovs_interfaceid": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:59:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d2a8d6f2-9ef6-4f74-b790-d854df95e4cd req-c0e4611d-b799-4f58-b356-3b41670f0242 service nova] Releasing lock "refresh_cache-6679686b-b418-41ce-a160-97ec9df754c7" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:59:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-08b425c1-c251-444f-aefb-04bac2697426 req-b044464b-2cd6-409d-9bab-b7f99ffe2ad7 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-08b425c1-c251-444f-aefb-04bac2697426 req-b044464b-2cd6-409d-9bab-b7f99ffe2ad7 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-08b425c1-c251-444f-aefb-04bac2697426 req-b044464b-2cd6-409d-9bab-b7f99ffe2ad7 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-08b425c1-c251-444f-aefb-04bac2697426 req-b044464b-2cd6-409d-9bab-b7f99ffe2ad7 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-08b425c1-c251-444f-aefb-04bac2697426 req-b044464b-2cd6-409d-9bab-b7f99ffe2ad7 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-08b425c1-c251-444f-aefb-04bac2697426 req-b044464b-2cd6-409d-9bab-b7f99ffe2ad7 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-f821c840-d892-434e-a289-affbb1fd08b6 for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-6776abbe-9d65-4c5e-8c7d-5fd532d77718 req-71ba3de3-a910-47a8-8c9b-33beb97041ed service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-a0750b9d-bbac-490f-af0f-f4ca13768c3c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6776abbe-9d65-4c5e-8c7d-5fd532d77718 req-71ba3de3-a910-47a8-8c9b-33beb97041ed service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6776abbe-9d65-4c5e-8c7d-5fd532d77718 req-71ba3de3-a910-47a8-8c9b-33beb97041ed service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6776abbe-9d65-4c5e-8c7d-5fd532d77718 req-71ba3de3-a910-47a8-8c9b-33beb97041ed service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-6776abbe-9d65-4c5e-8c7d-5fd532d77718 req-71ba3de3-a910-47a8-8c9b-33beb97041ed service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-a0750b9d-bbac-490f-af0f-f4ca13768c3c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-6776abbe-9d65-4c5e-8c7d-5fd532d77718 req-71ba3de3-a910-47a8-8c9b-33beb97041ed service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-a0750b9d-bbac-490f-af0f-f4ca13768c3c for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-211b86d0-c5d2-43fe-8583-b52a95b8ab0a req-e9d47402-4fea-4bd5-89ad-ac8da4ce5cff service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-211b86d0-c5d2-43fe-8583-b52a95b8ab0a req-e9d47402-4fea-4bd5-89ad-ac8da4ce5cff service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-211b86d0-c5d2-43fe-8583-b52a95b8ab0a req-e9d47402-4fea-4bd5-89ad-ac8da4ce5cff service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-211b86d0-c5d2-43fe-8583-b52a95b8ab0a req-e9d47402-4fea-4bd5-89ad-ac8da4ce5cff service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-211b86d0-c5d2-43fe-8583-b52a95b8ab0a req-e9d47402-4fea-4bd5-89ad-ac8da4ce5cff service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-211b86d0-c5d2-43fe-8583-b52a95b8ab0a req-e9d47402-4fea-4bd5-89ad-ac8da4ce5cff service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-b806d809-0e35-4345-8665-d3e15ad73b59 for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-a7dfe07b-27dc-4e8e-94b3-d4ad00a43924 req-6e8d9705-919a-44fd-9d32-3da5f6dbfe28 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a7dfe07b-27dc-4e8e-94b3-d4ad00a43924 req-6e8d9705-919a-44fd-9d32-3da5f6dbfe28 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a7dfe07b-27dc-4e8e-94b3-d4ad00a43924 req-6e8d9705-919a-44fd-9d32-3da5f6dbfe28 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a7dfe07b-27dc-4e8e-94b3-d4ad00a43924 req-6e8d9705-919a-44fd-9d32-3da5f6dbfe28 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-a7dfe07b-27dc-4e8e-94b3-d4ad00a43924 req-6e8d9705-919a-44fd-9d32-3da5f6dbfe28 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-a7dfe07b-27dc-4e8e-94b3-d4ad00a43924 req-6e8d9705-919a-44fd-9d32-3da5f6dbfe28 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-f821c840-d892-434e-a289-affbb1fd08b6 for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-a0750b9d-bbac-490f-af0f-f4ca13768c3c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-a0750b9d-bbac-490f-af0f-f4ca13768c3c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-a0750b9d-bbac-490f-af0f-f4ca13768c3c for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-b211e9e5-243c-481c-bfef-6b3a9c532a3c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-b211e9e5-243c-481c-bfef-6b3a9c532a3c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-b211e9e5-243c-481c-bfef-6b3a9c532a3c for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-b211e9e5-243c-481c-bfef-6b3a9c532a3c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-b211e9e5-243c-481c-bfef-6b3a9c532a3c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-b211e9e5-243c-481c-bfef-6b3a9c532a3c for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-9254f39e-f860-47d2-b274-12d409c79d83 for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-f5b6270b-be1d-4e3a-b5ee-157dc61f6240 req-69198495-1b02-45f5-954f-1c2c0eebb8b4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-9254f39e-f860-47d2-b274-12d409c79d83 for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-b806d809-0e35-4345-8665-d3e15ad73b59 for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-f10c9e61-e28f-4432-b85e-a91c1a205b1a for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Received event network-changed-8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Refreshing instance network info cache due to event network-changed-8689cc10-30f0-488d-abae-c8edc08c9750. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] Acquiring lock "refresh_cache-fab159b1-8768-4266-9a2f-3983628aeb86" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] Acquired lock "refresh_cache-fab159b1-8768-4266-9a2f-3983628aeb86" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Refreshing network info cache for port 8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-c3718589-da82-4d6b-90c5-2457773cdc05 req-f4da64be-c71e-45c5-81ef-659ac965c817 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Received event network-vif-plugged-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c3718589-da82-4d6b-90c5-2457773cdc05 req-f4da64be-c71e-45c5-81ef-659ac965c817 service nova] Acquiring lock "6679686b-b418-41ce-a160-97ec9df754c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c3718589-da82-4d6b-90c5-2457773cdc05 req-f4da64be-c71e-45c5-81ef-659ac965c817 service nova] Lock "6679686b-b418-41ce-a160-97ec9df754c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c3718589-da82-4d6b-90c5-2457773cdc05 req-f4da64be-c71e-45c5-81ef-659ac965c817 service nova] Lock "6679686b-b418-41ce-a160-97ec9df754c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-c3718589-da82-4d6b-90c5-2457773cdc05 req-f4da64be-c71e-45c5-81ef-659ac965c817 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] No waiting events found dispatching network-vif-plugged-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-c3718589-da82-4d6b-90c5-2457773cdc05 req-f4da64be-c71e-45c5-81ef-659ac965c817 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Received unexpected event network-vif-plugged-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-c3718589-da82-4d6b-90c5-2457773cdc05 req-f4da64be-c71e-45c5-81ef-659ac965c817 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Received event network-vif-plugged-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c3718589-da82-4d6b-90c5-2457773cdc05 req-f4da64be-c71e-45c5-81ef-659ac965c817 service nova] Acquiring lock "6679686b-b418-41ce-a160-97ec9df754c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c3718589-da82-4d6b-90c5-2457773cdc05 req-f4da64be-c71e-45c5-81ef-659ac965c817 service nova] Lock "6679686b-b418-41ce-a160-97ec9df754c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c3718589-da82-4d6b-90c5-2457773cdc05 req-f4da64be-c71e-45c5-81ef-659ac965c817 service nova] Lock "6679686b-b418-41ce-a160-97ec9df754c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-c3718589-da82-4d6b-90c5-2457773cdc05 req-f4da64be-c71e-45c5-81ef-659ac965c817 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] No waiting events found dispatching network-vif-plugged-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-c3718589-da82-4d6b-90c5-2457773cdc05 req-f4da64be-c71e-45c5-81ef-659ac965c817 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Received unexpected event network-vif-plugged-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-8eb85197-a692-45ab-86be-7c9f22fde75c req-6648f8a5-732d-4a88-b546-bfa2ba3cb5aa service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8eb85197-a692-45ab-86be-7c9f22fde75c req-6648f8a5-732d-4a88-b546-bfa2ba3cb5aa service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8eb85197-a692-45ab-86be-7c9f22fde75c req-6648f8a5-732d-4a88-b546-bfa2ba3cb5aa service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8eb85197-a692-45ab-86be-7c9f22fde75c req-6648f8a5-732d-4a88-b546-bfa2ba3cb5aa service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-8eb85197-a692-45ab-86be-7c9f22fde75c req-6648f8a5-732d-4a88-b546-bfa2ba3cb5aa service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-8eb85197-a692-45ab-86be-7c9f22fde75c req-6648f8a5-732d-4a88-b546-bfa2ba3cb5aa service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-18407b84-616b-4e09-98f0-1fe082ecd8ec for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-8eb85197-a692-45ab-86be-7c9f22fde75c req-6648f8a5-732d-4a88-b546-bfa2ba3cb5aa service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8eb85197-a692-45ab-86be-7c9f22fde75c req-6648f8a5-732d-4a88-b546-bfa2ba3cb5aa service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8eb85197-a692-45ab-86be-7c9f22fde75c req-6648f8a5-732d-4a88-b546-bfa2ba3cb5aa service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8eb85197-a692-45ab-86be-7c9f22fde75c req-6648f8a5-732d-4a88-b546-bfa2ba3cb5aa service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-8eb85197-a692-45ab-86be-7c9f22fde75c req-6648f8a5-732d-4a88-b546-bfa2ba3cb5aa service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.compute.manager [req-8eb85197-a692-45ab-86be-7c9f22fde75c req-6648f8a5-732d-4a88-b546-bfa2ba3cb5aa service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-18407b84-616b-4e09-98f0-1fe082ecd8ec for instance with vm_state building and task_state spawning.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:41 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Instance spawned successfully.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 03:59:41 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Instance spawned successfully.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:59:41 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7311MB free_disk=25.262588500976562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 03:59:41 user nova-compute[74540]: INFO nova.compute.manager [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Took 8.98 seconds to spawn the instance on the hypervisor.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:59:41 user nova-compute[74540]: INFO nova.compute.manager [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Took 14.24 seconds to spawn the instance on the hypervisor.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a3cae7a7-223c-438e-8206-39e0f1683cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d6501f90-9180-4e99-a294-9ffba799c247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6d43f26f-dfbb-4299-b875-f498979679d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 8c37887f-4c8a-4808-82a7-f8701dd9b62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d248eae-ef06-4be3-9178-15d54309be59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a78e9806-c043-437c-b085-108eee9a921b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance fab159b1-8768-4266-9a2f-3983628aeb86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance b0838704-02b2-4591-9d88-fe0dedcd8452 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6679686b-b418-41ce-a160-97ec9df754c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 03:59:41 user nova-compute[74540]: INFO nova.compute.manager [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Took 10.35 seconds to build instance.
Nov 07 03:59:41 user nova-compute[74540]: INFO nova.compute.manager [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Took 90.67 seconds to build instance.
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec7a5ffc-f1e2-4d30-bada-72dc796c202d tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "6679686b-b418-41ce-a160-97ec9df754c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.556s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c8c728f9-3cdc-48e9-9b1f-e9ba88b775fc tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 90.783s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG nova.network.neutron [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Updated VIF entry in instance network info cache for port 8689cc10-30f0-488d-abae-c8edc08c9750. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG nova.network.neutron [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Updating instance_info_cache with network_info: [{"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] Releasing lock "refresh_cache-fab159b1-8768-4266-9a2f-3983628aeb86" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG nova.compute.manager [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG nova.compute.manager [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:42 user nova-compute[74540]: WARNING nova.compute.manager [req-992e59b5-6d50-46e7-b879-00c835aa6a7d req-e5b30199-610c-486d-9aa0-e0eccf119e71 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-f10c9e61-e28f-4432-b85e-a91c1a205b1a for instance with vm_state building and task_state spawning.
Nov 07 03:59:42 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.719s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 03:59:42 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 03:59:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] [instance: a78e9806-c043-437c-b085-108eee9a921b] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjDMIkeg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:57 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:57 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:57 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8078ecd-e3ca-4600-83c8-930e4b81796e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 03:59:57 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71e2b78-68eb-4767-b77e-a7031bf9e5b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9] added
Nov 07 03:59:57 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cca35cc-51f5-4772-b534-77a245df2adf]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0649a832-6415-4215-8a0a-1419c4cb4b57]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjDMIkeg {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjDMIkeg" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24a369e-1f23-4f2c-a925-d97c61c8392a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bjDMIkeg'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 03:59:57 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Creating image(s)
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Ensure instance console log exists: /opt/stack/data/nova/instances/d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Start _get_guest_xml network_info=[{"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457812a7-f900-488c-9044-0eb5eccbe506", "address": "fa:16:3e:82:aa:43", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457812a7-f9", "ovs_interfaceid": "457812a7-f900-488c-9044-0eb5eccbe506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "address": "fa:16:3e:0e:5c:b7", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb75e6-78", "ovs_interfaceid": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtWGvosO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb37dc02-088b-464c-a566-e78213216c60', 'serial': 'fb37dc02-088b-464c-a566-e78213216c60'}, 'boot_index': 0, 'attachment_id': '6b7fbe05-b9f2-452d-a129-39f366eae841', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'stWLuSpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d', 'attached_at': '', 'detached_at': '', 'volume_id': '6586c99b-31cc-4c88-8c66-2af7f3a6d3fd', 'serial': '6586c99b-31cc-4c88-8c66-2af7f3a6d3fd'}, 'boot_index': 1, 'attachment_id': '31c2eb7d-3b08-4840-8159-f4b156c87b61', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVEeXgNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d', 'attached_at': '', 'detached_at': '', 'volume_id': '49d04f29-37ec-4d4e-a075-b4423dbff9b4', 'serial': '49d04f29-37ec-4d4e-a075-b4423dbff9b4'}, 'boot_index': 2, 'attachment_id': 'd71367bc-b191-4861-8692-cff4d82f14fd', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3416f1f-b0ca-48d7-a1b1-044d046b4dd3]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:57 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:59:57 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtWGvosO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:57 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad925c78-c678-4542-955f-d342c310c4fd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fed89c-c494-4673-9ef1-d4090319c88a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9, portal: 172.16.0.220,3260]
Nov 07 03:59:57 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9, portal: 172.16.0.220,3260] successful.
Nov 07 03:59:57 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea779ab-2f05-427c-be4b-2fa93902af85]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[758bb9c3-1c63-4cfd-aff1-9d09cca4d714]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 03:59:57 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb5e575-e138-47d7-9f76-9dcf8147ecdc]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjDMIkeg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9c5772c3-2096-4716-ace5-b3d884394cdf tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "5d248eae-ef06-4be3-9178-15d54309be59" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 54.596s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xacjmIiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:57 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:58 user nova-compute[74540]: INFO nova.compute.manager [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Rebuilding instance
Nov 07 03:59:58 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '26333656465643739', 'path': '/dev/sdh'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] [instance: a78e9806-c043-437c-b085-108eee9a921b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333656465643739', 'path': '/dev/sdh'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.214s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:58 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:58 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lazy-loading 'flavor' on Instance uuid a78e9806-c043-437c-b085-108eee9a921b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7312d811-a912-4812-939d-abd97c2592bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 03:59:58 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] attach device xml: <disk type="block" device="disk">
Nov 07 03:59:58 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 03:59:58 user nova-compute[74540]:   <source dev="/dev/sdh"/>
Nov 07 03:59:58 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 03:59:58 user nova-compute[74540]:   <serial>e31264b3-b7b7-4948-a9c9-2dbcc3905eb9</serial>
Nov 07 03:59:58 user nova-compute[74540]: </disk>
Nov 07 03:59:58 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bb7525-8750-4c8f-975c-6e5982e291c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60] added
Nov 07 03:59:58 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60a6312-4a3e-42ef-a8ba-9c29a029c100]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[237a1083-cecb-40a6-9434-bce4320a27fd]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtWGvosO {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtWGvosO" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f715d3-06e7-4f23-bbe0-c5655bb12404]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MtWGvosO'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e91dcb-0b4a-4586-a550-af8df924f419]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[940beb5a-38f8-4c55-9b18-daafeed20457]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4514d2c7-d5db-4730-bd5f-083dbfa2716d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60, portal: 172.16.0.220,3260]
Nov 07 03:59:58 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60, portal: 172.16.0.220,3260] successful.
Nov 07 03:59:58 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad88ab40-c75e-4c0e-8dce-daa71b46072b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d96633-0140-4239-bcb6-79f808af877d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 03:59:58 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.032s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc661625-c260-4ab4-91e9-f91fdf876e81]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 03:59:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtWGvosO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-82e058b9-ac96-4e30-986b-8fccc6cfdb5c req-e524899f-76f7-4454-8419-9a445c889467 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Received event network-vif-unplugged-8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-82e058b9-ac96-4e30-986b-8fccc6cfdb5c req-e524899f-76f7-4454-8419-9a445c889467 service nova] Acquiring lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-82e058b9-ac96-4e30-986b-8fccc6cfdb5c req-e524899f-76f7-4454-8419-9a445c889467 service nova] Lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-82e058b9-ac96-4e30-986b-8fccc6cfdb5c req-e524899f-76f7-4454-8419-9a445c889467 service nova] Lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-82e058b9-ac96-4e30-986b-8fccc6cfdb5c req-e524899f-76f7-4454-8419-9a445c889467 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] No waiting events found dispatching network-vif-unplugged-8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 03:59:59 user nova-compute[74540]: WARNING nova.compute.manager [req-82e058b9-ac96-4e30-986b-8fccc6cfdb5c req-e524899f-76f7-4454-8419-9a445c889467 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Received unexpected event network-vif-unplugged-8689cc10-30f0-488d-abae-c8edc08c9750 for instance with vm_state active and task_state rebuilding.
Nov 07 03:59:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] No VIF found with MAC fa:16:3e:4a:39:9d, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Acquiring lock "5d248eae-ef06-4be3-9178-15d54309be59" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "5d248eae-ef06-4be3-9178-15d54309be59" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.utils [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cef8dc-14ac-4366-8180-9e8f7b4ccc8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[859f644a-5231-469c-b42b-05dd31863bee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e76a08b-a217-40b4-a256-f732cb57988f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b383d13-54f1-400a-97da-be5fedf70aa6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:59 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Instance destroyed successfully.
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 03:59:59 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0d2684-3b15-4998-8c0f-e37f7b6b6e97]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.utils [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:59 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Instance destroyed successfully.
Nov 07 03:59:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-44869406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-61761870',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPey593voBblcXjUX6Rj4hYhQPXoWv5V3hZq/5nyg3saBjuq6wINCmOescCqsyejhlbUtRTx0iTq9cl/OfUi4sD2g9/3+n6UDIpNBD8OFscEKTzQMZbZpWSKD/LM735sYw==',key_name='tempest-keypair-1948852252',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:58:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb1ae9772ccb4183b607084edfb8c314',ramdisk_id='',reservation_id='r-bd4tsznq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1901483781',owner_user_name='tempest-ServerActionsV293TestJSON-1901483781-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:59:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aebf4eecd5445e3a118203654ae2dbe',uuid=fab159b1-8768-4266-9a2f-3983628aeb86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Converting VIF {"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:47,bridge_name='br-int',has_traffic_filtering=True,id=8689cc10-30f0-488d-abae-c8edc08c9750,network=Network(fe9b8c07-cd79-4cc9-9261-16946a99ce2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8689cc10-30') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_vif [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:47,bridge_name='br-int',has_traffic_filtering=True,id=8689cc10-30f0-488d-abae-c8edc08c9750,network=Network(fe9b8c07-cd79-4cc9-9261-16946a99ce2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8689cc10-30') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8689cc10-30, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ed6bf82-d18d-43c0-86fd-1021ccda1148) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 03:59:59 user nova-compute[74540]: INFO os_vif [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:47,bridge_name='br-int',has_traffic_filtering=True,id=8689cc10-30f0-488d-abae-c8edc08c9750,network=Network(fe9b8c07-cd79-4cc9-9261-16946a99ce2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8689cc10-30')
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7853587a-72a7-4d78-a76d-1cd64bc6b052 tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lock "a78e9806-c043-437c-b085-108eee9a921b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.689s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtdpoZls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:59 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:59 user nova-compute[74540]: INFO nova.compute.manager [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Swapping volume bef07b9d-ce1e-4543-abbd-ce125a6830e1 for 77f7f3b6-adbb-4908-b76d-f8a1a73200c7
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] <== connect_volume: return (2649ms) {'type': 'block', 'scsi_wwn': '23665383430646466', 'path': '/dev/sdi'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665383430646466', 'path': '/dev/sdi'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.110s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:59 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 03:59:59 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5685ce7a-b4f0-4ca9-8527-a83df3bc9b26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 03:59:59 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'stWLuSpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 03:59:59 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1037d601-8951-46be-97f4-bea9d84c987b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76] added
Nov 07 03:59:59 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1bbcf8-e531-4e2b-8b7c-950d57019860]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 03:59:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10e9284-9d05-4280-b6fd-9e66bfc9c0c9]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xacjmIiH {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xacjmIiH" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b420ef8b-b58e-4a79-8f80-2c6831598c9f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xacjmIiH'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ff3d4f-4e3c-426c-bd22-3ce576006fdb]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fafb82-4846-4f81-9f2e-6a8b31651ef5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dbaadb-30b0-469c-aed5-dce46ae96b78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76, portal: 172.16.0.220,3260]
Nov 07 04:00:00 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7d841b-f7c1-40f2-8327-05307d1b8a36]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6540ad52-e554-4c6d-928b-e7bd1c12add6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d52236d-2c3d-4077-82dc-bd19572b2f30]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xacjmIiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRaSHXdG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:00 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d812b77e-45b4-4a8c-a390-c5ab993074f7 tempest-VolumesAssistedSnapshotsTest-189245896 tempest-VolumesAssistedSnapshotsTest-189245896-project] [instance: a78e9806-c043-437c-b085-108eee9a921b] volume_snapshot_create: create_info: {'snapshot_id': '35449b6f-d7e4-42ac-ad92-f6b0d23ac804', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74540) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d812b77e-45b4-4a8c-a390-c5ab993074f7 tempest-VolumesAssistedSnapshotsTest-189245896 tempest-VolumesAssistedSnapshotsTest-189245896-project] [instance: a78e9806-c043-437c-b085-108eee9a921b] snap xml: <domainsnapshot>
Nov 07 04:00:00 user nova-compute[74540]:   <disks>
Nov 07 04:00:00 user nova-compute[74540]:     <disk name="/dev/sdh" snapshot="external" type="file">
Nov 07 04:00:00 user nova-compute[74540]:       <source file="/dev/new_file"/>
Nov 07 04:00:00 user nova-compute[74540]:     </disk>
Nov 07 04:00:00 user nova-compute[74540]:     <disk name="vda" snapshot="no"/>
Nov 07 04:00:00 user nova-compute[74540]:   </disks>
Nov 07 04:00:00 user nova-compute[74540]: </domainsnapshot>
Nov 07 04:00:00 user nova-compute[74540]:  {{(pid=74540) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 07 04:00:00 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d812b77e-45b4-4a8c-a390-c5ab993074f7 tempest-VolumesAssistedSnapshotsTest-189245896 tempest-VolumesAssistedSnapshotsTest-189245896-project] Lazy-loading 'system_metadata' on Instance uuid a78e9806-c043-437c-b085-108eee9a921b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:00 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d812b77e-45b4-4a8c-a390-c5ab993074f7 tempest-VolumesAssistedSnapshotsTest-189245896 tempest-VolumesAssistedSnapshotsTest-189245896-project] [instance: a78e9806-c043-437c-b085-108eee9a921b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [None req-d812b77e-45b4-4a8c-a390-c5ab993074f7 tempest-VolumesAssistedSnapshotsTest-189245896 tempest-VolumesAssistedSnapshotsTest-189245896-project] [instance: a78e9806-c043-437c-b085-108eee9a921b] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b] Traceback (most recent call last):
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     rv = execute(f, *args, **kwargs)
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     six.reraise(c, e, tb)
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     raise value
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     rv = meth(*args, **kwargs)
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b] 
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [None req-d812b77e-45b4-4a8c-a390-c5ab993074f7 tempest-VolumesAssistedSnapshotsTest-189245896 tempest-VolumesAssistedSnapshotsTest-189245896-project] [instance: a78e9806-c043-437c-b085-108eee9a921b] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b] Traceback (most recent call last):
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     self._volume_snapshot_create(context, instance, guest,
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     rv = execute(f, *args, **kwargs)
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     six.reraise(c, e, tb)
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     raise value
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     rv = meth(*args, **kwargs)
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b] 
Nov 07 04:00:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b5f03c1f-d123-4f26-95e5-75c82eaddd80 tempest-VolumesAssistedSnapshotsTest-189245896 tempest-VolumesAssistedSnapshotsTest-189245896-project] [instance: a78e9806-c043-437c-b085-108eee9a921b] volume_snapshot_delete: delete_info: {'volume_id': 'e31264b3-b7b7-4948-a9c9-2dbcc3905eb9'} {{(pid=74540) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [None req-b5f03c1f-d123-4f26-95e5-75c82eaddd80 tempest-VolumesAssistedSnapshotsTest-189245896 tempest-VolumesAssistedSnapshotsTest-189245896-project] [instance: a78e9806-c043-437c-b085-108eee9a921b] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b] Traceback (most recent call last):
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b]     if delete_info['type'] != 'qcow2':
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b] KeyError: 'type'
Nov 07 04:00:00 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [instance: a78e9806-c043-437c-b085-108eee9a921b] 
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [None req-d812b77e-45b4-4a8c-a390-c5ab993074f7 tempest-VolumesAssistedSnapshotsTest-189245896 tempest-VolumesAssistedSnapshotsTest-189245896-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 35449b6f-d7e4-42ac-ad92-f6b0d23ac804 could not be found.
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     raise value
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver 
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver 
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 35449b6f-d7e4-42ac-ad92-f6b0d23ac804 could not be found. (HTTP 404) (Request-ID: req-73c2f2c4-6823-460f-8e72-da63d9eaa62e)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver 
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver 
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 35449b6f-d7e4-42ac-ad92-f6b0d23ac804 could not be found.
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver 
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver [None req-b5f03c1f-d123-4f26-95e5-75c82eaddd80 tempest-VolumesAssistedSnapshotsTest-189245896 tempest-VolumesAssistedSnapshotsTest-189245896-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver 
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver 
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-20439234-be5a-4ec5-bcc7-c2268ce2ba35)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver 
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver 
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 07 04:00:01 user nova-compute[74540]: ERROR nova.virt.libvirt.driver 
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server [None req-d812b77e-45b4-4a8c-a390-c5ab993074f7 tempest-VolumesAssistedSnapshotsTest-189245896 tempest-VolumesAssistedSnapshotsTest-189245896-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise value
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server 
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.compute.manager [req-59e4e14e-fedc-4fa2-a450-ae7b03984eb5 req-68da49ab-b381-4fb2-a6ad-bcffd721f662 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Received event network-vif-plugged-8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-59e4e14e-fedc-4fa2-a450-ae7b03984eb5 req-68da49ab-b381-4fb2-a6ad-bcffd721f662 service nova] Acquiring lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-59e4e14e-fedc-4fa2-a450-ae7b03984eb5 req-68da49ab-b381-4fb2-a6ad-bcffd721f662 service nova] Lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-59e4e14e-fedc-4fa2-a450-ae7b03984eb5 req-68da49ab-b381-4fb2-a6ad-bcffd721f662 service nova] Lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.compute.manager [req-59e4e14e-fedc-4fa2-a450-ae7b03984eb5 req-68da49ab-b381-4fb2-a6ad-bcffd721f662 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] No waiting events found dispatching network-vif-plugged-8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:01 user nova-compute[74540]: WARNING nova.compute.manager [req-59e4e14e-fedc-4fa2-a450-ae7b03984eb5 req-68da49ab-b381-4fb2-a6ad-bcffd721f662 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Received unexpected event network-vif-plugged-8689cc10-30f0-488d-abae-c8edc08c9750 for instance with vm_state active and task_state rebuilding.
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server [None req-b5f03c1f-d123-4f26-95e5-75c82eaddd80 tempest-VolumesAssistedSnapshotsTest-189245896 tempest-VolumesAssistedSnapshotsTest-189245896-project] Exception during message handling: KeyError: 'type'
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 07 04:00:01 user nova-compute[74540]: ERROR oslo_messaging.rpc.server 
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] <== connect_volume: return (3556ms) {'type': 'block', 'scsi_wwn': '23333623865636361', 'path': '/dev/sdj'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333623865636361', 'path': '/dev/sdj'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.792s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lazy-loading 'flavor' on Instance uuid 6d43f26f-dfbb-4299-b875-f498979679d9 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b156d40-670a-4054-8143-7e35f3d41585]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:00:01 user nova-compute[74540]: No targets found.
Nov 07 04:00:01 user nova-compute[74540]: iSNS:
Nov 07 04:00:01 user nova-compute[74540]: No targets found.
Nov 07 04:00:01 user nova-compute[74540]: STATIC:
Nov 07 04:00:01 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace
Nov 07 04:00:01 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:01 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:01 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1
Nov 07 04:00:01 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:01 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:01 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:00:01 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:01 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:01 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03
Nov 07 04:00:01 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:01 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:01 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:00:01 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:01 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:01 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80
Nov 07 04:00:01 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:01 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:01 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76
Nov 07 04:00:01 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:01 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:01 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9
Nov 07 04:00:01 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:01 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:01 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1
Nov 07 04:00:01 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:01 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:01 user nova-compute[74540]: FIRMWARE:
Nov 07 04:00:01 user nova-compute[74540]: No targets found.
Nov 07 04:00:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:00:01 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:00:01 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:00:01 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:01 user nova-compute[74540]:   <source dev="/dev/sdj"/>
Nov 07 04:00:01 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:00:01 user nova-compute[74540]:   <serial>a0a4e5cd-6c7f-4099-bca6-84607868ca76</serial>
Nov 07 04:00:01 user nova-compute[74540]: </disk>
Nov 07 04:00:01 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5174a4c9-d6f9-4cd4-9bf2-16ad1511c720]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[de17764d-eef4-4753-84a8-7ee50763435a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee142908b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9e0c7d-bb68-4ca3-96f9-4c3dc180b5e5]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3179e6b-461e-4ef3-a89e-590e4b641be2]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d07c5aa-e0c4-4af5-8776-bcf746e1dd3d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.081s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0653b10-0cf6-4fd6-817b-66243c5fc0bc]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Acquiring lock "a78e9806-c043-437c-b085-108eee9a921b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lock "a78e9806-c043-437c-b085-108eee9a921b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:01 user nova-compute[74540]: INFO nova.compute.manager [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] [instance: a78e9806-c043-437c-b085-108eee9a921b] Detaching volume e31264b3-b7b7-4948-a9c9-2dbcc3905eb9
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[392744a6-3a99-4338-b962-cadabb4e0e7b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:01 user nova-compute[74540]: INFO nova.virt.block_device [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] [instance: a78e9806-c043-437c-b085-108eee9a921b] Attempting to driver detach volume e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 from mountpoint /dev/vdb
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ed581e-dfca-4d68-a9f7-80f808bc29fd]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1, portal: 172.16.0.220,3260]
Nov 07 04:00:01 user nova-compute[74540]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Attempting to detach device vdb from instance a78e9806-c043-437c-b085-108eee9a921b from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] detach device xml: <disk type="block" device="disk">
Nov 07 04:00:01 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:01 user nova-compute[74540]:   <source dev="/dev/sdh"/>
Nov 07 04:00:01 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:00:01 user nova-compute[74540]:   <serial>e31264b3-b7b7-4948-a9c9-2dbcc3905eb9</serial>
Nov 07 04:00:01 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:00:01 user nova-compute[74540]: </disk>
Nov 07 04:00:01 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4bbb73-6e19-4395-b850-0c2053b94634]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.549s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] <== disconnect_volume: return (2342ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:00:01 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Deleting instance files /opt/stack/data/nova/instances/fab159b1-8768-4266-9a2f-3983628aeb86_del
Nov 07 04:00:01 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Deletion of /opt/stack/data/nova/instances/fab159b1-8768-4266-9a2f-3983628aeb86_del complete
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.971s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:01 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:01 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:00:01 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Successfully detached device vdb from instance a78e9806-c043-437c-b085-108eee9a921b from the persistent domain config.
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a78e9806-c043-437c-b085-108eee9a921b from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] detach device xml: <disk type="block" device="disk">
Nov 07 04:00:01 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:01 user nova-compute[74540]:   <source dev="/dev/sdh"/>
Nov 07 04:00:01 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:00:01 user nova-compute[74540]:   <serial>e31264b3-b7b7-4948-a9c9-2dbcc3905eb9</serial>
Nov 07 04:00:01 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:00:01 user nova-compute[74540]: </disk>
Nov 07 04:00:01 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] No VIF found with MAC fa:16:3e:48:2e:c5, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0b7515-20ff-47df-afc3-2a1966c7fb74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:00:01 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce587627-4159-4246-b3ec-753fcda314ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd] added
Nov 07 04:00:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8eb2cb-cd0e-4b44-89d5-462278b05411]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f938db5-2d99-40fb-9287-183cc8fe0f91]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v stWLuSpX {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v stWLuSpX" returned: 0 in 0.033s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a722c7-65a8-4383-87e7-107e17ba91de]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'stWLuSpX'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[399e9434-feea-4a4b-831b-ee532cf69ffc]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e166288e-a54a-4fa3-aaca-c6430eaa8f33]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7eb04a07-5922-41fa-b29e-84f7d241401c tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "6d43f26f-dfbb-4299-b875-f498979679d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.217s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:02 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance fab159b1-8768-4266-9a2f-3983628aeb86 could not be found.
Nov 07 04:00:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtdpoZls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:02 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --login" returned: 0 in 0.132s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[231f5490-7f0d-499b-8e26-0b15aa3faa2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd, portal: 172.16.0.220,3260]
Nov 07 04:00:02 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef71919-3b31-45a9-be5b-eaa2e57abfcd]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b3fe3b-16d7-47bf-8a56-0e53ed341a6e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.459s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[08052c76-5660-4f7f-be6a-45db3f641152]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'stWLuSpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:00:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a78e9806-c043-437c-b085-108eee9a921b {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.507s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] <== connect_volume: return (3478ms) {'type': 'block', 'scsi_wwn': '23735386435613330', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735386435613330', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.708s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:03 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:03 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb5d851-780a-411b-afe5-4d29f8db0f43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:00:03 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVEeXgNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:03 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aad2cb-4673-4a0c-a467-92eaf3c5c8b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f] added
Nov 07 04:00:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7252a21-d254-4c70-b105-6ad1eacb4ca6]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad015da6-50c3-4da5-94c1-b62152faad5b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRaSHXdG {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRaSHXdG" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aed2271-fb31-4899-8d93-fb3de0439f1e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NRaSHXdG'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3fe891-205f-4835-9bac-998f1f9791a2]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "6d43f26f-dfbb-4299-b875-f498979679d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:03 user nova-compute[74540]: INFO nova.compute.manager [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Detaching volume a0a4e5cd-6c7f-4099-bca6-84607868ca76
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[db405117-125c-40a9-8ef4-a9d70b91573a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:03 user nova-compute[74540]: INFO nova.virt.block_device [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Attempting to driver detach volume a0a4e5cd-6c7f-4099-bca6-84607868ca76 from mountpoint /dev/vdb
Nov 07 04:00:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Attempting to detach device vdb from instance 6d43f26f-dfbb-4299-b875-f498979679d9 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:00:03 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:03 user nova-compute[74540]:   <source dev="/dev/sdj"/>
Nov 07 04:00:03 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:00:03 user nova-compute[74540]:   <serial>a0a4e5cd-6c7f-4099-bca6-84607868ca76</serial>
Nov 07 04:00:03 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:00:03 user nova-compute[74540]: </disk>
Nov 07 04:00:03 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:00:03 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Successfully detached device vdb from instance 6d43f26f-dfbb-4299-b875-f498979679d9 from the persistent domain config.
Nov 07 04:00:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6d43f26f-dfbb-4299-b875-f498979679d9 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:00:03 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:03 user nova-compute[74540]:   <source dev="/dev/sdj"/>
Nov 07 04:00:03 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:00:03 user nova-compute[74540]:   <serial>a0a4e5cd-6c7f-4099-bca6-84607868ca76</serial>
Nov 07 04:00:03 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:00:03 user nova-compute[74540]: </disk>
Nov 07 04:00:03 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bbb714-4df8-4347-96f8-fcb91d6faf7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f, portal: 172.16.0.220,3260]
Nov 07 04:00:03 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[23526fc5-c5cb-43b4-8b2a-41bf7e452391]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b588035-cb46-4d13-9698-95e378501009]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64fb977-98a4-4788-8a39-82e0b28e3116]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:03 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6d43f26f-dfbb-4299-b875-f498979679d9 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRaSHXdG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] <== connect_volume: return (4127ms) {'type': 'block', 'scsi_wwn': '26261643961336136', 'path': '/dev/sdk'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261643961336136', 'path': '/dev/sdk'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.621s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG nova.objects.instance [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lazy-loading 'flavor' on Instance uuid 8c37887f-4c8a-4808-82a7-f8701dd9b62e {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e1c23c-1459-4bf5-ae60-91fae37ecc3f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:00:04 user nova-compute[74540]: No targets found.
Nov 07 04:00:04 user nova-compute[74540]: iSNS:
Nov 07 04:00:04 user nova-compute[74540]: No targets found.
Nov 07 04:00:04 user nova-compute[74540]: STATIC:
Nov 07 04:00:04 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f
Nov 07 04:00:04 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:04 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:04 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace
Nov 07 04:00:04 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:04 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:04 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:00:04 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:04 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:04 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03
Nov 07 04:00:04 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:04 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:04 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:00:04 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:04 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:04 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:00:04 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:04 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:04 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80
Nov 07 04:00:04 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:04 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:04 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76
Nov 07 04:00:04 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:04 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:04 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9
Nov 07 04:00:04 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:04 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:04 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1
Nov 07 04:00:04 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:04 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:04 user nova-compute[74540]: FIRMWARE:
Nov 07 04:00:04 user nova-compute[74540]: No targets found.
Nov 07 04:00:04 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:00:04 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:00:04 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:00:04 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:04 user nova-compute[74540]:   <source dev="/dev/sdk"/>
Nov 07 04:00:04 user nova-compute[74540]:   <target dev="sdc" bus="scsi"/>
Nov 07 04:00:04 user nova-compute[74540]:   <serial>45ae65cc-97a4-4886-8c5f-e641f99dea1f</serial>
Nov 07 04:00:04 user nova-compute[74540]:   <address type="drive" controller="0" unit="2"/>
Nov 07 04:00:04 user nova-compute[74540]: </disk>
Nov 07 04:00:04 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9eebb-2365-4642-998f-fd8eca54f576]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2c1ec5-8ef3-4500-9fd2-58607044f24a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:04 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:04 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:04 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc388e50>, {}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Disconnecting from: [] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.103s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] <== disconnect_volume: return (2724ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.493s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:04 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:04 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b66b1c-7860-4f45-af98-c6c706769fd2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:00:04 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccebf4c-beca-4fb9-a890-abd409643bc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4] added
Nov 07 04:00:05 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecda7e9c-3558-4dd5-8f57-86764e1a6606]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44a3535-c88a-4376-a9e2-79370c53e361]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVEeXgNy {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVEeXgNy" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fef9fd2-8f03-4c6b-ada4-333c648bf604]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JVEeXgNy'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[294ffdcb-aead-434f-a5f8-765df2157825]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ee8756-4825-4c36-b8ea-246a249fd5a2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[af942311-1a45-41d4-be8d-27ad48f10438]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4, portal: 172.16.0.220,3260]
Nov 07 04:00:05 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:05 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb3fb4d-0804-4ffc-b108-d2b68edf564c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[846d8012-41fc-4910-ae3a-009cb3819755]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:05 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad78faa-23d3-4f35-ba44-31689f1d1fc4]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVEeXgNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] No BDM found with device name sda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] No VIF found with MAC fa:16:3e:06:0d:dc, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:00:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cea63d7e-adac-4162-b78c-fb2c8e5605ef tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.459s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Preparing to wait for external event volume-reimaged-9edaab1d-3869-4da4-81e8-39c0bd9687a1 {{(pid=74540) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] <== connect_volume: return (2923ms) {'type': 'block', 'scsi_wwn': '26666356461376439', 'path': '/dev/sdl'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666356461376439', 'path': '/dev/sdl'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:5a:40,bridge_name='br-int',has_traffic_filtering=True,id=43c2db66-9652-40e8-8b69-3b9cc77cd456,network=Network(bcc480dd-9844-44a4-89a8-986b8aa74a9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c2db66-96') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:3a,bridge_name='br-int',has_traffic_filtering=True,id=8eee84ce-8974-4c32-8f84-7e399c631085,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eee84ce-89') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:a5:84,bridge_name='br-int',has_traffic_filtering=True,id=53b6e456-7f50-428b-a729-8acbb635add5,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53b6e456-7f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=57eef42e-ec2b-44c5-aa5b-45e943f783e2,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57eef42e-ec') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:1d:b1,bridge_name='br-int',has_traffic_filtering=True,id=819961d9-d8e8-4cfb-b022-4a2eb954754a,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819961d9-d8') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "457812a7-f900-488c-9044-0eb5eccbe506", "address": "fa:16:3e:82:aa:43", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457812a7-f9", "ovs_interfaceid": "457812a7-f900-488c-9044-0eb5eccbe506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "457812a7-f900-488c-9044-0eb5eccbe506", "address": "fa:16:3e:82:aa:43", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457812a7-f9", "ovs_interfaceid": "457812a7-f900-488c-9044-0eb5eccbe506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=457812a7-f900-488c-9044-0eb5eccbe506,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457812a7-f9') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "address": "fa:16:3e:0e:5c:b7", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb75e6-78", "ovs_interfaceid": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "address": "fa:16:3e:0e:5c:b7", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb75e6-78", "ovs_interfaceid": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=33bb75e6-7891-4c52-874c-855c3c1ac9c5,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb75e6-78') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lazy-loading 'pci_devices' on Instance uuid d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:00:06 user nova-compute[74540]:   <uuid>d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d</uuid>
Nov 07 04:00:06 user nova-compute[74540]:   <name>instance-0000000c</name>
Nov 07 04:00:06 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:00:06 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:00:06 user nova-compute[74540]:   <metadata>
Nov 07 04:00:06 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:00:06 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:00:06 user nova-compute[74540]:       <nova:name>tempest-device-tagging-server-1182088429</nova:name>
Nov 07 04:00:06 user nova-compute[74540]:       <nova:creationTime>2023-11-07 03:59:57</nova:creationTime>
Nov 07 04:00:06 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:00:06 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:00:06 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:00:06 user nova-compute[74540]:       <nova:owner>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:user uuid="d27d820855314e489ea12aba2f488449">tempest-TaggedBootDevicesTest_v242-1268906931-project-member</nova:user>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:project uuid="6cfb8ff5a06d455c981ce7051e424aa1">tempest-TaggedBootDevicesTest_v242-1268906931</nova:project>
Nov 07 04:00:06 user nova-compute[74540]:       </nova:owner>
Nov 07 04:00:06 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:00:06 user nova-compute[74540]:       <nova:ports>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:port uuid="43c2db66-9652-40e8-8b69-3b9cc77cd456">
Nov 07 04:00:06 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 04:00:06 user nova-compute[74540]:         </nova:port>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:port uuid="8eee84ce-8974-4c32-8f84-7e399c631085">
Nov 07 04:00:06 user nova-compute[74540]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Nov 07 04:00:06 user nova-compute[74540]:         </nova:port>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:port uuid="53b6e456-7f50-428b-a729-8acbb635add5">
Nov 07 04:00:06 user nova-compute[74540]:           <nova:ip type="fixed" address="10.1.1.198" ipVersion="4"/>
Nov 07 04:00:06 user nova-compute[74540]:         </nova:port>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:port uuid="57eef42e-ec2b-44c5-aa5b-45e943f783e2">
Nov 07 04:00:06 user nova-compute[74540]:           <nova:ip type="fixed" address="10.1.1.152" ipVersion="4"/>
Nov 07 04:00:06 user nova-compute[74540]:         </nova:port>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:port uuid="819961d9-d8e8-4cfb-b022-4a2eb954754a">
Nov 07 04:00:06 user nova-compute[74540]:           <nova:ip type="fixed" address="10.1.1.56" ipVersion="4"/>
Nov 07 04:00:06 user nova-compute[74540]:         </nova:port>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:port uuid="457812a7-f900-488c-9044-0eb5eccbe506">
Nov 07 04:00:06 user nova-compute[74540]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 07 04:00:06 user nova-compute[74540]:         </nova:port>
Nov 07 04:00:06 user nova-compute[74540]:         <nova:port uuid="33bb75e6-7891-4c52-874c-855c3c1ac9c5">
Nov 07 04:00:06 user nova-compute[74540]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 07 04:00:06 user nova-compute[74540]:         </nova:port>
Nov 07 04:00:06 user nova-compute[74540]:       </nova:ports>
Nov 07 04:00:06 user nova-compute[74540]:     </nova:instance>
Nov 07 04:00:06 user nova-compute[74540]:   </metadata>
Nov 07 04:00:06 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:00:06 user nova-compute[74540]:     <system>
Nov 07 04:00:06 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:00:06 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:00:06 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:00:06 user nova-compute[74540]:       <entry name="serial">d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d</entry>
Nov 07 04:00:06 user nova-compute[74540]:       <entry name="uuid">d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d</entry>
Nov 07 04:00:06 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:00:06 user nova-compute[74540]:     </system>
Nov 07 04:00:06 user nova-compute[74540]:   </sysinfo>
Nov 07 04:00:06 user nova-compute[74540]:   <os>
Nov 07 04:00:06 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:00:06 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:00:06 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:00:06 user nova-compute[74540]:   </os>
Nov 07 04:00:06 user nova-compute[74540]:   <features>
Nov 07 04:00:06 user nova-compute[74540]:     <acpi/>
Nov 07 04:00:06 user nova-compute[74540]:     <apic/>
Nov 07 04:00:06 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:00:06 user nova-compute[74540]:   </features>
Nov 07 04:00:06 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:00:06 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:00:06 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:00:06 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:00:06 user nova-compute[74540]:   </clock>
Nov 07 04:00:06 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:00:06 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:00:06 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:00:06 user nova-compute[74540]:   </cpu>
Nov 07 04:00:06 user nova-compute[74540]:   <devices>
Nov 07 04:00:06 user nova-compute[74540]:     <disk type="file" device="cdrom">
Nov 07 04:00:06 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none"/>
Nov 07 04:00:06 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d/disk.config"/>
Nov 07 04:00:06 user nova-compute[74540]:       <target dev="hda" bus="ide"/>
Nov 07 04:00:06 user nova-compute[74540]:     </disk>
Nov 07 04:00:06 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:00:06 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:06 user nova-compute[74540]:       <source dev="/dev/sdi"/>
Nov 07 04:00:06 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:00:06 user nova-compute[74540]:       <serial>fb37dc02-088b-464c-a566-e78213216c60</serial>
Nov 07 04:00:06 user nova-compute[74540]:     </disk>
Nov 07 04:00:06 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:00:06 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:06 user nova-compute[74540]:       <source dev="/dev/sdb"/>
Nov 07 04:00:06 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 04:00:06 user nova-compute[74540]:       <serial>6586c99b-31cc-4c88-8c66-2af7f3a6d3fd</serial>
Nov 07 04:00:06 user nova-compute[74540]:     </disk>
Nov 07 04:00:06 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:00:06 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:06 user nova-compute[74540]:       <source dev="/dev/sdl"/>
Nov 07 04:00:06 user nova-compute[74540]:       <target dev="vdc" bus="virtio"/>
Nov 07 04:00:06 user nova-compute[74540]:       <serial>49d04f29-37ec-4d4e-a075-b4423dbff9b4</serial>
Nov 07 04:00:06 user nova-compute[74540]:     </disk>
Nov 07 04:00:06 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:00:06 user nova-compute[74540]:       <mac address="fa:16:3e:89:5a:40"/>
Nov 07 04:00:06 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:00:06 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:00:06 user nova-compute[74540]:       <target dev="tap43c2db66-96"/>
Nov 07 04:00:06 user nova-compute[74540]:     </interface>
Nov 07 04:00:06 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:00:06 user nova-compute[74540]:       <mac address="fa:16:3e:b9:2c:3a"/>
Nov 07 04:00:06 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:00:06 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:00:06 user nova-compute[74540]:       <target dev="tap8eee84ce-89"/>
Nov 07 04:00:06 user nova-compute[74540]:     </interface>
Nov 07 04:00:06 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:00:06 user nova-compute[74540]:       <mac address="fa:16:3e:06:a5:84"/>
Nov 07 04:00:06 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:00:06 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:00:06 user nova-compute[74540]:       <target dev="tap53b6e456-7f"/>
Nov 07 04:00:06 user nova-compute[74540]:     </interface>
Nov 07 04:00:06 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:00:06 user nova-compute[74540]:       <mac address="fa:16:3e:de:f1:61"/>
Nov 07 04:00:06 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:00:06 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:00:06 user nova-compute[74540]:       <target dev="tap57eef42e-ec"/>
Nov 07 04:00:06 user nova-compute[74540]:     </interface>
Nov 07 04:00:06 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:00:06 user nova-compute[74540]:       <mac address="fa:16:3e:cb:1d:b1"/>
Nov 07 04:00:06 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:00:06 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:00:06 user nova-compute[74540]:       <target dev="tap819961d9-d8"/>
Nov 07 04:00:06 user nova-compute[74540]:     </interface>
Nov 07 04:00:06 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:00:06 user nova-compute[74540]:       <mac address="fa:16:3e:82:aa:43"/>
Nov 07 04:00:06 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:00:06 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:00:06 user nova-compute[74540]:       <target dev="tap457812a7-f9"/>
Nov 07 04:00:06 user nova-compute[74540]:     </interface>
Nov 07 04:00:06 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:00:06 user nova-compute[74540]:       <mac address="fa:16:3e:0e:5c:b7"/>
Nov 07 04:00:06 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:00:06 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:00:06 user nova-compute[74540]:       <target dev="tap33bb75e6-78"/>
Nov 07 04:00:06 user nova-compute[74540]:     </interface>
Nov 07 04:00:06 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:00:06 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d/console.log" append="off"/>
Nov 07 04:00:06 user nova-compute[74540]:     </serial>
Nov 07 04:00:06 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:00:06 user nova-compute[74540]:     <video>
Nov 07 04:00:06 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:00:06 user nova-compute[74540]:     </video>
Nov 07 04:00:06 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:00:06 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:00:06 user nova-compute[74540]:     </rng>
Nov 07 04:00:06 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:00:06 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:00:06 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:00:06 user nova-compute[74540]:     </memballoon>
Nov 07 04:00:06 user nova-compute[74540]:   </devices>
Nov 07 04:00:06 user nova-compute[74540]: </domain>
Nov 07 04:00:06 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:5a:40,bridge_name='br-int',has_traffic_filtering=True,id=43c2db66-9652-40e8-8b69-3b9cc77cd456,network=Network(bcc480dd-9844-44a4-89a8-986b8aa74a9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c2db66-96') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:5a:40,bridge_name='br-int',has_traffic_filtering=True,id=43c2db66-9652-40e8-8b69-3b9cc77cd456,network=Network(bcc480dd-9844-44a4-89a8-986b8aa74a9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c2db66-96') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'caee37b4-6806-59f0-a3ca-7876ad091eab', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43c2db66-96, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43c2db66-96, col_values=(('qos', UUID('26bf12b7-cd05-4fc8-8274-b04e9a5ee1c3')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43c2db66-96, col_values=(('external_ids', {'iface-id': '43c2db66-9652-40e8-8b69-3b9cc77cd456', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:5a:40', 'vm-uuid': 'd1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: INFO nova.compute.manager [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Detaching volume 45ae65cc-97a4-4886-8c5f-e641f99dea1f
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: INFO os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:5a:40,bridge_name='br-int',has_traffic_filtering=True,id=43c2db66-9652-40e8-8b69-3b9cc77cd456,network=Network(bcc480dd-9844-44a4-89a8-986b8aa74a9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c2db66-96')
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:3a,bridge_name='br-int',has_traffic_filtering=True,id=8eee84ce-8974-4c32-8f84-7e399c631085,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eee84ce-89') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:3a,bridge_name='br-int',has_traffic_filtering=True,id=8eee84ce-8974-4c32-8f84-7e399c631085,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eee84ce-89') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09763275-e75c-5dad-8610-40f3b70868a9', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eee84ce-89, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8eee84ce-89, col_values=(('qos', UUID('64cd4801-7e85-416c-b1d7-dc846a234f84')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8eee84ce-89, col_values=(('external_ids', {'iface-id': '8eee84ce-8974-4c32-8f84-7e399c631085', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:2c:3a', 'vm-uuid': 'd1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:06 user nova-compute[74540]: INFO nova.virt.block_device [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Attempting to driver detach volume 45ae65cc-97a4-4886-8c5f-e641f99dea1f from mountpoint /dev/sdc
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: INFO os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:3a,bridge_name='br-int',has_traffic_filtering=True,id=8eee84ce-8974-4c32-8f84-7e399c631085,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eee84ce-89')
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:a5:84,bridge_name='br-int',has_traffic_filtering=True,id=53b6e456-7f50-428b-a729-8acbb635add5,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53b6e456-7f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:a5:84,bridge_name='br-int',has_traffic_filtering=True,id=53b6e456-7f50-428b-a729-8acbb635add5,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53b6e456-7f') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ddbcf5d-b524-5557-ae0e-5a7dda9d84e6', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Attempting to detach device sdc from instance 8c37887f-4c8a-4808-82a7-f8701dd9b62e from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:00:06 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:06 user nova-compute[74540]:   <source dev="/dev/sdk"/>
Nov 07 04:00:06 user nova-compute[74540]:   <target dev="sdc" bus="scsi"/>
Nov 07 04:00:06 user nova-compute[74540]:   <serial>45ae65cc-97a4-4886-8c5f-e641f99dea1f</serial>
Nov 07 04:00:06 user nova-compute[74540]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 07 04:00:06 user nova-compute[74540]: </disk>
Nov 07 04:00:06 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Successfully detached device sdc from instance 8c37887f-4c8a-4808-82a7-f8701dd9b62e from the persistent domain config.
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 8c37887f-4c8a-4808-82a7-f8701dd9b62e from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:00:06 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:06 user nova-compute[74540]:   <source dev="/dev/sdk"/>
Nov 07 04:00:06 user nova-compute[74540]:   <target dev="sdc" bus="scsi"/>
Nov 07 04:00:06 user nova-compute[74540]:   <serial>45ae65cc-97a4-4886-8c5f-e641f99dea1f</serial>
Nov 07 04:00:06 user nova-compute[74540]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 07 04:00:06 user nova-compute[74540]: </disk>
Nov 07 04:00:06 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53b6e456-7f, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53b6e456-7f, col_values=(('qos', UUID('abd89543-e1e4-4543-a68c-2f259942f76e')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53b6e456-7f, col_values=(('external_ids', {'iface-id': '53b6e456-7f50-428b-a729-8acbb635add5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:a5:84', 'vm-uuid': 'd1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: INFO os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:a5:84,bridge_name='br-int',has_traffic_filtering=True,id=53b6e456-7f50-428b-a729-8acbb635add5,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53b6e456-7f')
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=57eef42e-ec2b-44c5-aa5b-45e943f783e2,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57eef42e-ec') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=57eef42e-ec2b-44c5-aa5b-45e943f783e2,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57eef42e-ec') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4bc80e5-845d-5975-9c71-20bc63806973', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57eef42e-ec, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57eef42e-ec, col_values=(('qos', UUID('63ec0260-4c7b-40aa-b8a0-98f5e6707bd1')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57eef42e-ec, col_values=(('external_ids', {'iface-id': '57eef42e-ec2b-44c5-aa5b-45e943f783e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:f1:61', 'vm-uuid': 'd1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: INFO os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=57eef42e-ec2b-44c5-aa5b-45e943f783e2,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57eef42e-ec')
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:1d:b1,bridge_name='br-int',has_traffic_filtering=True,id=819961d9-d8e8-4cfb-b022-4a2eb954754a,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819961d9-d8') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:1d:b1,bridge_name='br-int',has_traffic_filtering=True,id=819961d9-d8e8-4cfb-b022-4a2eb954754a,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819961d9-d8') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f97aa2a-1255-52bb-87e1-45950b703e61', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap819961d9-d8, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap819961d9-d8, col_values=(('qos', UUID('91524ae8-aab2-4cb7-9070-26f086b352cb')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap819961d9-d8, col_values=(('external_ids', {'iface-id': '819961d9-d8e8-4cfb-b022-4a2eb954754a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:1d:b1', 'vm-uuid': 'd1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: INFO os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:1d:b1,bridge_name='br-int',has_traffic_filtering=True,id=819961d9-d8e8-4cfb-b022-4a2eb954754a,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819961d9-d8')
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "457812a7-f900-488c-9044-0eb5eccbe506", "address": "fa:16:3e:82:aa:43", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457812a7-f9", "ovs_interfaceid": "457812a7-f900-488c-9044-0eb5eccbe506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "457812a7-f900-488c-9044-0eb5eccbe506", "address": "fa:16:3e:82:aa:43", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457812a7-f9", "ovs_interfaceid": "457812a7-f900-488c-9044-0eb5eccbe506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=457812a7-f900-488c-9044-0eb5eccbe506,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457812a7-f9') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=457812a7-f900-488c-9044-0eb5eccbe506,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457812a7-f9') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5864831-98fa-50d7-b3bf-0a59539fadf2', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap457812a7-f9, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap457812a7-f9, col_values=(('qos', UUID('2be3f417-e41e-44e2-af34-e80399890268')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap457812a7-f9, col_values=(('external_ids', {'iface-id': '457812a7-f900-488c-9044-0eb5eccbe506', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:aa:43', 'vm-uuid': 'd1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 8c37887f-4c8a-4808-82a7-f8701dd9b62e {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:07 user nova-compute[74540]: INFO os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=457812a7-f900-488c-9044-0eb5eccbe506,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457812a7-f9')
Nov 07 04:00:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "address": "fa:16:3e:0e:5c:b7", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb75e6-78", "ovs_interfaceid": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "address": "fa:16:3e:0e:5c:b7", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb75e6-78", "ovs_interfaceid": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=33bb75e6-7891-4c52-874c-855c3c1ac9c5,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb75e6-78') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=33bb75e6-7891-4c52-874c-855c3c1ac9c5,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb75e6-78') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58b08707-4a06-5370-8423-e61a94788561', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33bb75e6-78, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33bb75e6-78, col_values=(('qos', UUID('4f66711d-e1be-4ac7-bf19-4a6ef802ff06')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33bb75e6-78, col_values=(('external_ids', {'iface-id': '33bb75e6-7891-4c52-874c-855c3c1ac9c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:5c:b7', 'vm-uuid': 'd1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:07 user nova-compute[74540]: INFO os_vif [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=33bb75e6-7891-4c52-874c-855c3c1ac9c5,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb75e6-78')
Nov 07 04:00:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] No BDM found with device name hda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] No VIF found with MAC fa:16:3e:89:5a:40, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] No VIF found with MAC fa:16:3e:cb:1d:b1, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:00:07 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Using config drive
Nov 07 04:00:07 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Creating config drive at /opt/stack/data/nova/instances/d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d/disk.config
Nov 07 04:00:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph9bctx1r {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph9bctx1r" returned: 0 in 0.055s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-aed5ae56-b9c6-4676-b11b-5fcb40a9bc81 req-5f666e5b-293d-4654-9e7e-0d2d6b2b6396 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-aed5ae56-b9c6-4676-b11b-5fcb40a9bc81 req-5f666e5b-293d-4654-9e7e-0d2d6b2b6396 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-aed5ae56-b9c6-4676-b11b-5fcb40a9bc81 req-5f666e5b-293d-4654-9e7e-0d2d6b2b6396 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-aed5ae56-b9c6-4676-b11b-5fcb40a9bc81 req-5f666e5b-293d-4654-9e7e-0d2d6b2b6396 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-aed5ae56-b9c6-4676-b11b-5fcb40a9bc81 req-5f666e5b-293d-4654-9e7e-0d2d6b2b6396 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:09 user nova-compute[74540]: WARNING nova.compute.manager [req-aed5ae56-b9c6-4676-b11b-5fcb40a9bc81 req-5f666e5b-293d-4654-9e7e-0d2d6b2b6396 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-43c2db66-9652-40e8-8b69-3b9cc77cd456 for instance with vm_state building and task_state spawning.
Nov 07 04:00:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-e1f3fa4b-68de-44ac-8ac7-e650eb62fd57 req-42ab2b79-6e72-43e9-816b-e3113fbc8fc5 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-8eee84ce-8974-4c32-8f84-7e399c631085 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e1f3fa4b-68de-44ac-8ac7-e650eb62fd57 req-42ab2b79-6e72-43e9-816b-e3113fbc8fc5 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e1f3fa4b-68de-44ac-8ac7-e650eb62fd57 req-42ab2b79-6e72-43e9-816b-e3113fbc8fc5 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e1f3fa4b-68de-44ac-8ac7-e650eb62fd57 req-42ab2b79-6e72-43e9-816b-e3113fbc8fc5 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-e1f3fa4b-68de-44ac-8ac7-e650eb62fd57 req-42ab2b79-6e72-43e9-816b-e3113fbc8fc5 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-8eee84ce-8974-4c32-8f84-7e399c631085 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:09 user nova-compute[74540]: WARNING nova.compute.manager [req-e1f3fa4b-68de-44ac-8ac7-e650eb62fd57 req-42ab2b79-6e72-43e9-816b-e3113fbc8fc5 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-8eee84ce-8974-4c32-8f84-7e399c631085 for instance with vm_state building and task_state spawning.
Nov 07 04:00:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-7e31e4ba-e804-4257-a61e-8c414693745c req-8bf16764-53cd-4cdf-8cda-faa3789aea02 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-53b6e456-7f50-428b-a729-8acbb635add5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7e31e4ba-e804-4257-a61e-8c414693745c req-8bf16764-53cd-4cdf-8cda-faa3789aea02 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7e31e4ba-e804-4257-a61e-8c414693745c req-8bf16764-53cd-4cdf-8cda-faa3789aea02 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7e31e4ba-e804-4257-a61e-8c414693745c req-8bf16764-53cd-4cdf-8cda-faa3789aea02 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-7e31e4ba-e804-4257-a61e-8c414693745c req-8bf16764-53cd-4cdf-8cda-faa3789aea02 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-53b6e456-7f50-428b-a729-8acbb635add5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:09 user nova-compute[74540]: WARNING nova.compute.manager [req-7e31e4ba-e804-4257-a61e-8c414693745c req-8bf16764-53cd-4cdf-8cda-faa3789aea02 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-53b6e456-7f50-428b-a729-8acbb635add5 for instance with vm_state building and task_state spawning.
Nov 07 04:00:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5d894080-6467-4921-bfb2-73b2e447c1a9 req-4ca3b69d-ab46-40f5-bc76-6b03e72b1938 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5d894080-6467-4921-bfb2-73b2e447c1a9 req-4ca3b69d-ab46-40f5-bc76-6b03e72b1938 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5d894080-6467-4921-bfb2-73b2e447c1a9 req-4ca3b69d-ab46-40f5-bc76-6b03e72b1938 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5d894080-6467-4921-bfb2-73b2e447c1a9 req-4ca3b69d-ab46-40f5-bc76-6b03e72b1938 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5d894080-6467-4921-bfb2-73b2e447c1a9 req-4ca3b69d-ab46-40f5-bc76-6b03e72b1938 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:11 user nova-compute[74540]: WARNING nova.compute.manager [req-5d894080-6467-4921-bfb2-73b2e447c1a9 req-4ca3b69d-ab46-40f5-bc76-6b03e72b1938 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-43c2db66-9652-40e8-8b69-3b9cc77cd456 for instance with vm_state building and task_state spawning.
Nov 07 04:00:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-8eee84ce-8974-4c32-8f84-7e399c631085 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-8eee84ce-8974-4c32-8f84-7e399c631085 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:11 user nova-compute[74540]: WARNING nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-8eee84ce-8974-4c32-8f84-7e399c631085 for instance with vm_state building and task_state spawning.
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:11 user nova-compute[74540]: WARNING nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-57eef42e-ec2b-44c5-aa5b-45e943f783e2 for instance with vm_state building and task_state spawning.
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:11 user nova-compute[74540]: WARNING nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-57eef42e-ec2b-44c5-aa5b-45e943f783e2 for instance with vm_state building and task_state spawning.
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:11 user nova-compute[74540]: WARNING nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-819961d9-d8e8-4cfb-b022-4a2eb954754a for instance with vm_state building and task_state spawning.
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:11 user nova-compute[74540]: WARNING nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-819961d9-d8e8-4cfb-b022-4a2eb954754a for instance with vm_state building and task_state spawning.
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:11 user nova-compute[74540]: WARNING nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-33bb75e6-7891-4c52-874c-855c3c1ac9c5 for instance with vm_state building and task_state spawning.
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:11 user nova-compute[74540]: WARNING nova.compute.manager [req-5757763c-3a14-4b34-8b34-d24fb8135ad3 req-26402351-d936-462b-bc42-d20386478407 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-33bb75e6-7891-4c52-874c-855c3c1ac9c5 for instance with vm_state building and task_state spawning.
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-53b6e456-7f50-428b-a729-8acbb635add5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-53b6e456-7f50-428b-a729-8acbb635add5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:11 user nova-compute[74540]: WARNING nova.compute.manager [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-53b6e456-7f50-428b-a729-8acbb635add5 for instance with vm_state building and task_state spawning.
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:11 user nova-compute[74540]: WARNING nova.compute.manager [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-457812a7-f900-488c-9044-0eb5eccbe506 for instance with vm_state building and task_state spawning.
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:11 user nova-compute[74540]: WARNING nova.compute.manager [req-f5c5ef29-0892-427b-b514-ce4c4d38c976 req-3c673cfb-2f7a-4ed6-bee9-e052df2fea70 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-457812a7-f900-488c-9044-0eb5eccbe506 for instance with vm_state building and task_state spawning.
Nov 07 04:00:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:00:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:00:13 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Instance spawned successfully.
Nov 07 04:00:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:00:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:00:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:00:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:00:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:00:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:00:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:00:13 user nova-compute[74540]: INFO nova.compute.manager [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Took 16.35 seconds to spawn the instance on the hypervisor.
Nov 07 04:00:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:00:13 user nova-compute[74540]: INFO nova.compute.manager [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Took 122.31 seconds to build instance.
Nov 07 04:00:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7691225-38b7-4b3c-94b3-6824ca5cb57b tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 122.418s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lazy-loading 'flavor' on Instance uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:20 user nova-compute[74540]: INFO nova.compute.manager [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Attaching volume 196b6636-9efd-4905-b7a2-36a457b6818d to /dev/vdb
Nov 07 04:00:20 user nova-compute[74540]: DEBUG os_brick.utils [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a305ca6-2aee-4d8c-916e-03f4aec1fafe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[533e37d6-4489-44dc-a2dd-e26d357517d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d315653-3f55-4756-b533-0f310456c6cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e097df97-6209-46d1-ac84-e249ba3104b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:00:20 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:00:20 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fb1069-c281-450b-9fa7-8b159862599c]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG os_brick.utils [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:20 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updating existing volume attachment record: 97454ef2-7d7d-44cf-882e-038042c41925 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:22 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a78e9806-c043-437c-b085-108eee9a921b is timed out.
Nov 07 04:00:22 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Successfully detached device vdb from instance a78e9806-c043-437c-b085-108eee9a921b from the live domain config.
Nov 07 04:00:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] [instance: a78e9806-c043-437c-b085-108eee9a921b] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjDMIkeg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:22 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4ebb86-6837-45a1-84c0-d823998ce48f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:00:22 user nova-compute[74540]: No targets found.
Nov 07 04:00:22 user nova-compute[74540]: iSNS:
Nov 07 04:00:22 user nova-compute[74540]: No targets found.
Nov 07 04:00:22 user nova-compute[74540]: STATIC:
Nov 07 04:00:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:00:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f
Nov 07 04:00:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace
Nov 07 04:00:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:00:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03
Nov 07 04:00:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:00:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:00:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80
Nov 07 04:00:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76
Nov 07 04:00:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9
Nov 07 04:00:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1
Nov 07 04:00:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:22 user nova-compute[74540]: FIRMWARE:
Nov 07 04:00:22 user nova-compute[74540]: No targets found.
Nov 07 04:00:22 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:00:22 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:00:22 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc440d31-4d8c-4ca5-a8db-bb7aa07a7917]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ea959-8ed3-4a76-9d3d-01daee9dcb3d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:22 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee143aec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9'): ({'sdh'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Removing single pathed devices sdh {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2e003e-0c90-43cf-a501-e5d5e9021cda]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df737ce-c6be-4ebc-85a1-4985c909e1de]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Flushing IO for device /dev/sdh {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e964b605-6b13-4801-99b7-dc39ee08f778]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e569d0-4f52-479e-81f3-0384cda58d7a]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] SCSI volumes sdh have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.052s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27c83b9-4a8f-4702-a1de-951d09915176]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a462cf83-5ba0-41c2-838f-7816d48839e5]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9, portal: 172.16.0.220,3260]
Nov 07 04:00:23 user nova-compute[74540]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:23 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e31264b3-b7b7-4948-a9c9-2dbcc3905eb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42f58b3-2b88-4aa7-a2c5-99f0014b6dfc]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.526s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] <== disconnect_volume: return (531ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] [instance: a78e9806-c043-437c-b085-108eee9a921b] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG nova.objects.instance [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lazy-loading 'flavor' on Instance uuid a78e9806-c043-437c-b085-108eee9a921b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b67837a1-83da-4e94-bdb1-18d9efbdd99f tempest-VolumesAssistedSnapshotsTest-1041021766 tempest-VolumesAssistedSnapshotsTest-1041021766-project-admin] Lock "a78e9806-c043-437c-b085-108eee9a921b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.413s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:24 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6d43f26f-dfbb-4299-b875-f498979679d9 is timed out.
Nov 07 04:00:24 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Successfully detached device vdb from instance 6d43f26f-dfbb-4299-b875-f498979679d9 from the live domain config.
Nov 07 04:00:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xacjmIiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:24 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae1d6e3-660a-4fee-9226-e9e3b61546a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:00:24 user nova-compute[74540]: No targets found.
Nov 07 04:00:24 user nova-compute[74540]: iSNS:
Nov 07 04:00:24 user nova-compute[74540]: No targets found.
Nov 07 04:00:24 user nova-compute[74540]: STATIC:
Nov 07 04:00:24 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:00:24 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:24 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:24 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f
Nov 07 04:00:24 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:24 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:24 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace
Nov 07 04:00:24 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:24 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:24 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:00:24 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:24 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:24 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03
Nov 07 04:00:24 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:24 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:24 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:00:24 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:24 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:24 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:00:24 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:24 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:24 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80
Nov 07 04:00:24 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:24 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:24 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76
Nov 07 04:00:24 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:24 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:24 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1
Nov 07 04:00:24 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:24 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:24 user nova-compute[74540]: FIRMWARE:
Nov 07 04:00:24 user nova-compute[74540]: No targets found.
Nov 07 04:00:24 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:00:24 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:00:24 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc54636a-e7ab-457d-8836-769eff745c97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[299704d7-9705-46d4-a893-ff7d8d6cceab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:24 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:24 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:24 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc38f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76'): ({'sdj'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Removing single pathed devices sdj {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[23224eea-7c96-49dd-be08-81dc8991d49b]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c2c7ca-01e4-4c64-b79a-7049a00ce30f]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Flushing IO for device /dev/sdj {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e8f97b-ee2f-48e6-aa90-7e81753cd4a9]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.046s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f016ae-fcf4-40f5-84f9-645b94afbb52]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] SCSI volumes sdj have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1757658-cc85-4850-afb5-3e138ce8dbf1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e5aeca-9dd6-4e72-8d89-f7c7084f55aa]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76, portal: 172.16.0.220,3260]
Nov 07 04:00:24 user nova-compute[74540]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:24 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0a4e5cd-6c7f-4099-bca6-84607868ca76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6d8b92-ebde-40a3-ad32-7ae4e0adbe8a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] <== disconnect_volume: return (401ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:00:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:00:25 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lazy-loading 'flavor' on Instance uuid 6d43f26f-dfbb-4299-b875-f498979679d9 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d4d69820-2a3c-4f1c-be97-e1329e71878b tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "6d43f26f-dfbb-4299-b875-f498979679d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.051s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:25 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:00:27 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 8c37887f-4c8a-4808-82a7-f8701dd9b62e is timed out.
Nov 07 04:00:27 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Successfully detached device sdc from instance 8c37887f-4c8a-4808-82a7-f8701dd9b62e from the live domain config.
Nov 07 04:00:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRaSHXdG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:27 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb309534-3c08-44c6-9f97-d430b1fd4244]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:00:27 user nova-compute[74540]: No targets found.
Nov 07 04:00:27 user nova-compute[74540]: iSNS:
Nov 07 04:00:27 user nova-compute[74540]: No targets found.
Nov 07 04:00:27 user nova-compute[74540]: STATIC:
Nov 07 04:00:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:00:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f
Nov 07 04:00:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace
Nov 07 04:00:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:00:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03
Nov 07 04:00:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:00:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:00:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80
Nov 07 04:00:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1
Nov 07 04:00:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:27 user nova-compute[74540]: FIRMWARE:
Nov 07 04:00:27 user nova-compute[74540]: No targets found.
Nov 07 04:00:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:00:27 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:00:27 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dea321-e6ab-42d4-a0a4-d1a684df369a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d92bca-4e1c-45e6-8e09-85412b539812]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:27 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc38d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f'): ({'sdk'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Removing single pathed devices sdk {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbb673c-16bb-4a2a-9ff2-1b44b89a07fe]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e37edc-5536-4096-8a59-c7c26f4e2451]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Flushing IO for device /dev/sdk {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[476cc3b9-6ec2-4e2c-9f7b-eebe44847c44]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.036s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bf2511-f33d-4d35-91e9-9212f2656de5]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] SCSI volumes sdk have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[53045d36-0fda-422b-8cdd-a4ecb14510f8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9ec8c0-c373-4dbc-9694-7b12bccbf5a0]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f, portal: 172.16.0.220,3260]
Nov 07 04:00:27 user nova-compute[74540]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45ae65cc-97a4-4886-8c5f-e641f99dea1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aa2e1a-4b53-4bfd-930e-8b797c930c8f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] <== disconnect_volume: return (376ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:00:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:00:28 user nova-compute[74540]: DEBUG nova.objects.instance [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lazy-loading 'flavor' on Instance uuid 8c37887f-4c8a-4808-82a7-f8701dd9b62e {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-351d091a-4608-43d5-87b7-51208d3f8d0c tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.055s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:28 user nova-compute[74540]: DEBUG nova.compute.manager [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yANdbMsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5d248eae-ef06-4be3-9178-15d54309be59', 'attached_at': '', 'detached_at': '', 'volume_id': '77f7f3b6-adbb-4908-b76d-f8a1a73200c7', 'serial': '77f7f3b6-adbb-4908-b76d-f8a1a73200c7'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCfRSmPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '5d248eae-ef06-4be3-9178-15d54309be59', 'attached_at': '', 'detached_at': '', 'volume_id': 'bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'serial'} {{(pid=74540) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 07 04:00:28 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yANdbMsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:29 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:29 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:29 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lazy-loading 'flavor' on Instance uuid a3cae7a7-223c-438e-8206-39e0f1683cb0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec823bf-40cf-4781-9be1-7d6aff9d9606]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:00:29 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d617a5-1ef0-4ba6-a8a4-ebfc183f324d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7] added
Nov 07 04:00:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede1651d-fbf7-4f28-8aa9-90b950265994]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[48daa24b-a209-4eb6-8dc5-8ab009433413]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yANdbMsr {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yANdbMsr" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a0dd06-71b6-4826-819e-48d028d4fe45]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yANdbMsr'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a37321-8f7e-498e-ade6-0e66b5e42d70]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:29 user nova-compute[74540]: INFO nova.compute.manager [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Terminating instance
Nov 07 04:00:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[94abc5d1-a6f9-4546-96ad-0b2e0ba17ce2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:29 user nova-compute[74540]: INFO nova.compute.manager [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Attaching volume 615b5148-e91d-4c64-8ad2-084c8f7108e8 to /dev/vdb
Nov 07 04:00:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.133s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1aa992-8c9c-4af6-8aa2-00281a78e7c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7, portal: 172.16.0.220,3260]
Nov 07 04:00:29 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f62bfb1-41bf-47d2-a9b7-1800aa18abf1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.utils [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd80f239-cdc1-4380-9750-dbd62962f7f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a778335-097b-47d4-a316-ef1e31048965]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f157b9e-6d6f-44cb-80e5-0af7cfe1c976]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.037s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[77db9757-9a20-4534-9b54-517f4e337ed2]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yANdbMsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.039s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b41b1b-1901-4812-8908-02c884e3a49d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff46ab6-c466-48b2-8d0e-4a65d3ca637e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:00:29 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7e13de-18db-4c56-b0c3-cba7dba2b15a]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG os_brick.utils [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating existing volume attachment record: f6436b13-b193-4f71-a5aa-7eaea4b33eff {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-abaed8b1-c109-403c-a1e0-04a9d8857eec req-c6a8ca04-0c7a-4af1-a82e-285d4a102f38 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Received event network-vif-unplugged-d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-abaed8b1-c109-403c-a1e0-04a9d8857eec req-c6a8ca04-0c7a-4af1-a82e-285d4a102f38 service nova] Acquiring lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-abaed8b1-c109-403c-a1e0-04a9d8857eec req-c6a8ca04-0c7a-4af1-a82e-285d4a102f38 service nova] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-abaed8b1-c109-403c-a1e0-04a9d8857eec req-c6a8ca04-0c7a-4af1-a82e-285d4a102f38 service nova] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-abaed8b1-c109-403c-a1e0-04a9d8857eec req-c6a8ca04-0c7a-4af1-a82e-285d4a102f38 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] No waiting events found dispatching network-vif-unplugged-d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-abaed8b1-c109-403c-a1e0-04a9d8857eec req-c6a8ca04-0c7a-4af1-a82e-285d4a102f38 service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Received event network-vif-unplugged-d711d258-7e53-4467-93ca-6ed95045095a for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:00:29 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:00:30 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Instance destroyed successfully.
Nov 07 04:00:30 user nova-compute[74540]: DEBUG nova.objects.instance [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lazy-loading 'resources' on Instance uuid 8c37887f-4c8a-4808-82a7-f8701dd9b62e {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:57:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1505121729',display_name='tempest-AttachSCSIVolumeTestJSON-server-1505121729',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1505121729',id=7,image_ref='71ec3b79-a312-4d68-aa41-fc70d1c4fd3a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQSaEGTymH5++JQ4ijpLImrZkPHTlnxcj95cjU7Ani9W/fWYtrr5I8Q7k9A2iW9yAgo7PlVITpn0+hwpFPgZM26nEXqPGzz4UpVgZnHx5tna9UA5KmBWpOhDTyzW+AiCg==',key_name='tempest-keypair-1842096411',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:57:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9165dbae4d9448d6adba10e82cbfc624',ramdisk_id='',reservation_id='r-u3xdqloq',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='71ec3b79-a312-4d68-aa41-fc70d1c4fd3a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-75211980',owner_user_name='tempest-AttachSCSIVolumeTestJSON-75211980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a51748f5c554aee820cf07dfe3883a0',uuid=8c37887f-4c8a-4808-82a7-f8701dd9b62e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d711d258-7e53-4467-93ca-6ed95045095a", "address": "fa:16:3e:06:0d:dc", "network": {"id": "9397df5e-5494-42e9-b228-e6e56895fd13", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1555022831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9165dbae4d9448d6adba10e82cbfc624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd711d258-7e", "ovs_interfaceid": "d711d258-7e53-4467-93ca-6ed95045095a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Converting VIF {"id": "d711d258-7e53-4467-93ca-6ed95045095a", "address": "fa:16:3e:06:0d:dc", "network": {"id": "9397df5e-5494-42e9-b228-e6e56895fd13", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1555022831-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9165dbae4d9448d6adba10e82cbfc624", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd711d258-7e", "ovs_interfaceid": "d711d258-7e53-4467-93ca-6ed95045095a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=d711d258-7e53-4467-93ca-6ed95045095a,network=Network(9397df5e-5494-42e9-b228-e6e56895fd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd711d258-7e') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG os_vif [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=d711d258-7e53-4467-93ca-6ed95045095a,network=Network(9397df5e-5494-42e9-b228-e6e56895fd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd711d258-7e') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd711d258-7e, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91e54c29-f364-4ce3-bbeb-b873468f6aa4) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:30 user nova-compute[74540]: INFO os_vif [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=d711d258-7e53-4467-93ca-6ed95045095a,network=Network(9397df5e-5494-42e9-b228-e6e56895fd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd711d258-7e')
Nov 07 04:00:30 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Deleting instance files /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e_del
Nov 07 04:00:30 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Deletion of /opt/stack/data/nova/instances/8c37887f-4c8a-4808-82a7-f8701dd9b62e_del complete
Nov 07 04:00:30 user nova-compute[74540]: INFO nova.compute.manager [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 07 04:00:30 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.509s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] <== connect_volume: return (1511ms) {'type': 'block', 'scsi_wwn': '23331373238353465', 'path': '/dev/sdh'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331373238353465', 'path': '/dev/sdh'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG nova.objects.instance [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lazy-loading 'flavor' on Instance uuid 5d248eae-ef06-4be3-9178-15d54309be59 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:00:30 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:00:31 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Took 1.24 seconds to deallocate network for instance.
Nov 07 04:00:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-0f08f733-39e5-4b3f-8d32-74cc135fa2bd req-c020727f-e201-451e-9fd9-41f6ec15a53c service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Received event network-vif-deleted-d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:31 user nova-compute[74540]: INFO nova.compute.manager [req-0f08f733-39e5-4b3f-8d32-74cc135fa2bd req-c020727f-e201-451e-9fd9-41f6ec15a53c service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Neutron deleted interface d711d258-7e53-4467-93ca-6ed95045095a; detaching it from the instance and deleting it from the info cache
Nov 07 04:00:31 user nova-compute[74540]: DEBUG nova.network.neutron [req-0f08f733-39e5-4b3f-8d32-74cc135fa2bd req-c020727f-e201-451e-9fd9-41f6ec15a53c service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-0f08f733-39e5-4b3f-8d32-74cc135fa2bd req-c020727f-e201-451e-9fd9-41f6ec15a53c service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Detach interface failed, port_id=d711d258-7e53-4467-93ca-6ed95045095a, reason: Instance 8c37887f-4c8a-4808-82a7-f8701dd9b62e could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 38797312 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating instance_info_cache with network_info: [{"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-d51b6392-0eba-4465-b3a0-d2e015d204df req-efa07051-7bf5-4c41-829a-ea5d4afdd86f service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Received event network-vif-plugged-d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d51b6392-0eba-4465-b3a0-d2e015d204df req-efa07051-7bf5-4c41-829a-ea5d4afdd86f service nova] Acquiring lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d51b6392-0eba-4465-b3a0-d2e015d204df req-efa07051-7bf5-4c41-829a-ea5d4afdd86f service nova] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d51b6392-0eba-4465-b3a0-d2e015d204df req-efa07051-7bf5-4c41-829a-ea5d4afdd86f service nova] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-d51b6392-0eba-4465-b3a0-d2e015d204df req-efa07051-7bf5-4c41-829a-ea5d4afdd86f service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] No waiting events found dispatching network-vif-plugged-d711d258-7e53-4467-93ca-6ed95045095a {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:31 user nova-compute[74540]: WARNING nova.compute.manager [req-d51b6392-0eba-4465-b3a0-d2e015d204df req-efa07051-7bf5-4c41-829a-ea5d4afdd86f service nova] [instance: 8c37887f-4c8a-4808-82a7-f8701dd9b62e] Received unexpected event network-vif-plugged-d711d258-7e53-4467-93ca-6ed95045095a for instance with vm_state deleted and task_state None.
Nov 07 04:00:31 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:00:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 175112192 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:00:32 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:00:32 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:00:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.748s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.407s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:00:32 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Deleted allocations for instance 8c37887f-4c8a-4808-82a7-f8701dd9b62e
Nov 07 04:00:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 291504128 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:00:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-86b3f82b-63ae-48ef-b2b3-56259b5b04ea tempest-AttachSCSIVolumeTestJSON-75211980 tempest-AttachSCSIVolumeTestJSON-75211980-project-member] Lock "8c37887f-4c8a-4808-82a7-f8701dd9b62e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.391s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 380633088 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:00:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:00:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 549453824 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:00:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 693108736 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:00:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 816840704 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:00:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 894435328 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:00:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 1033895936 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:00:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCfRSmPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:36 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eab39b2-069f-4fe9-8c01-705d02c65c57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:00:36 user nova-compute[74540]: No targets found.
Nov 07 04:00:36 user nova-compute[74540]: iSNS:
Nov 07 04:00:36 user nova-compute[74540]: No targets found.
Nov 07 04:00:36 user nova-compute[74540]: STATIC:
Nov 07 04:00:36 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:00:36 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:36 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:36 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace
Nov 07 04:00:36 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:36 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:36 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7
Nov 07 04:00:36 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:36 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:36 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:00:36 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:36 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:36 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03
Nov 07 04:00:36 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:36 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:36 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:00:36 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:36 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:36 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:00:36 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:36 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:36 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80
Nov 07 04:00:36 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:36 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:36 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1
Nov 07 04:00:36 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:36 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:36 user nova-compute[74540]: FIRMWARE:
Nov 07 04:00:36 user nova-compute[74540]: No targets found.
Nov 07 04:00:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:00:36 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:00:36 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7a6078-7665-4f6f-acbc-ea2104fea4ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[389b762e-5ee3-4db5-ab80-d523ed22e227]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:00:36 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee141d51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1'): ({'sdg'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Removing single pathed devices sdg {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a8d0f0-cc5b-4fa1-8a95-02b488cb89a0]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[934a2c65-2a68-4780-8f4c-6d7c7008979c]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Flushing IO for device /dev/sdg {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe081990-3df1-4c16-a0b4-e9002d563edb]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af41279-a327-4d42-b85e-1f759d20dfbd]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] SCSI volumes sdg have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a5b459-7c47-4800-b5a7-b91c59a1070e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f78d50-d8f5-46d2-bf64-ad119de4998d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260]
Nov 07 04:00:36 user nova-compute[74540]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a00973-7163-46f7-9f90-45102bbe04f4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] <== disconnect_volume: return (420ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yANdbMsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '5d248eae-ef06-4be3-9178-15d54309be59', 'attached_at': '', 'detached_at': '', 'volume_id': '77f7f3b6-adbb-4908-b76d-f8a1a73200c7', 'serial'} {{(pid=74540) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 07 04:00:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] swap_volume: removing Cinder connection for volume bef07b9d-ce1e-4543-abbd-ce125a6830e1 {{(pid=74540) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 07 04:00:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:00:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:00:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:00:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:00:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:00:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:00:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdl (vdc) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.manager [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] swap_volume: Updating volume bef07b9d-ce1e-4543-abbd-ce125a6830e1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "yANdbMsr", "auth_password": "uALczk2YX74Kf0", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "77f7f3b6-adbb-4908-b76d-f8a1a73200c7"}, "status": "reserved", "instance": "5d248eae-ef06-4be3-9178-15d54309be59", "attached_at": "", "detached_at": "", "volume_id": "77f7f3b6-adbb-4908-b76d-f8a1a73200c7", "serial": "77f7f3b6-adbb-4908-b76d-f8a1a73200c7"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '77f7f3b6-adbb-4908-b76d-f8a1a73200c7', 'no_device': None, 'attachment_id': 'fb276c84-3d67-446f-bb8e-6c83f0f91ed2'} {{(pid=74540) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 07 04:00:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:00:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7227MB free_disk=25.239349365234375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-78d4dcac-473d-40df-9585-6f5bc1419648 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "5d248eae-ef06-4be3-9178-15d54309be59" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 38.886s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a3cae7a7-223c-438e-8206-39e0f1683cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d6501f90-9180-4e99-a294-9ffba799c247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6d43f26f-dfbb-4299-b875-f498979679d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d248eae-ef06-4be3-9178-15d54309be59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a78e9806-c043-437c-b085-108eee9a921b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance fab159b1-8768-4266-9a2f-3983628aeb86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance b0838704-02b2-4591-9d88-fe0dedcd8452 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6679686b-b418-41ce-a160-97ec9df754c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Acquiring lock "5d248eae-ef06-4be3-9178-15d54309be59" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "5d248eae-ef06-4be3-9178-15d54309be59" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG os_brick.utils [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f74c063-0946-4b4a-bf51-ba90d8738e34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c98fd74-264f-45cd-9b2a-65b9fe4f4098]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9569ee65-39cb-4cc6-b9d9-55d6596005fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d544f0-e722-4e82-a995-4a8887fabd2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:00:38 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:00:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4548a036-dc35-416f-9182-7f3dd639c87a]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:00:38 user nova-compute[74540]: DEBUG os_brick.utils [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] <== get_connector_properties: return (208ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:39 user nova-compute[74540]: INFO nova.compute.manager [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Swapping volume 77f7f3b6-adbb-4908-b76d-f8a1a73200c7 for bef07b9d-ce1e-4543-abbd-ce125a6830e1
Nov 07 04:00:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:00:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:00:39 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:00:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhWLADTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:49 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:49 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:49 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ec14ae-0180-446f-bada-b6edb1f673f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:00:49 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b20fa0f-38d6-4fc2-9c3b-30889449ee9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d] added
Nov 07 04:00:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c521529b-b33b-4c05-9ad1-dceaaf529012]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e58a97-935a-49eb-92b8-ca5bdeca3bfb]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhWLADTM {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhWLADTM" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[211ba916-d743-4a9f-9dc0-64ef1e990451]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fhWLADTM'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d9e1e9-8374-4293-91ad-89f2036faff5]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[051d1c47-117d-4a86-8c59-95e4cb286e44]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:49 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad5f9ac-2a57-4503-8ae9-da2ecd8fdb13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d, portal: 172.16.0.220,3260]
Nov 07 04:00:49 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d83670-7d19-4b82-8ead-b820f1f50e78]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe8e21a-a9aa-4045-b167-7a59be73f6a5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:50 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:50 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:50 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] HCTL ('38', '-', '-', 0) found on session 15 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5065c3-a9e2-450a-ab0b-bf9e8657534c]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Searching for a device in session 15 and hctl ['38', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:51 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Searching for a device in session 15 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:00:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhWLADTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:00:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26531623039616462', 'path': '/dev/sdg'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531623039616462', 'path': '/dev/sdg'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:00:51 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lazy-loading 'flavor' on Instance uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:00:51 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:51 user nova-compute[74540]:   <source dev="/dev/sdg"/>
Nov 07 04:00:51 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:00:51 user nova-compute[74540]:   <serial>196b6636-9efd-4905-b7a2-36a457b6818d</serial>
Nov 07 04:00:51 user nova-compute[74540]: </disk>
Nov 07 04:00:51 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:00:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] No VIF found with MAC fa:16:3e:72:c8:7f, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:00:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ffa22c41-2946-4971-9397-f345f0e7578e tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.097s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:52 user nova-compute[74540]: INFO nova.compute.manager [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Rescuing
Nov 07 04:00:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:00:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquired lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:00:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:00:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-82538d5e-a15a-479b-a91b-f71db23f3e9c req-27592265-f049-4dff-81fa-2c7352d07a2b service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-changed-f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-82538d5e-a15a-479b-a91b-f71db23f3e9c req-27592265-f049-4dff-81fa-2c7352d07a2b service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing instance network info cache due to event network-changed-f821c840-d892-434e-a289-affbb1fd08b6. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:00:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-82538d5e-a15a-479b-a91b-f71db23f3e9c req-27592265-f049-4dff-81fa-2c7352d07a2b service nova] Acquiring lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:00:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-82538d5e-a15a-479b-a91b-f71db23f3e9c req-27592265-f049-4dff-81fa-2c7352d07a2b service nova] Acquired lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:00:52 user nova-compute[74540]: DEBUG nova.network.neutron [req-82538d5e-a15a-479b-a91b-f71db23f3e9c req-27592265-f049-4dff-81fa-2c7352d07a2b service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Refreshing network info cache for port f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:00:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updating instance_info_cache with network_info: [{"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:00:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Releasing lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:00:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-fe77424b-4104-4d72-bc12-858a8068830a req-39b96647-193d-41c8-bb81-245c63a21576 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-unplugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fe77424b-4104-4d72-bc12-858a8068830a req-39b96647-193d-41c8-bb81-245c63a21576 service nova] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fe77424b-4104-4d72-bc12-858a8068830a req-39b96647-193d-41c8-bb81-245c63a21576 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fe77424b-4104-4d72-bc12-858a8068830a req-39b96647-193d-41c8-bb81-245c63a21576 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-fe77424b-4104-4d72-bc12-858a8068830a req-39b96647-193d-41c8-bb81-245c63a21576 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] No waiting events found dispatching network-vif-unplugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:53 user nova-compute[74540]: WARNING nova.compute.manager [req-fe77424b-4104-4d72-bc12-858a8068830a req-39b96647-193d-41c8-bb81-245c63a21576 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received unexpected event network-vif-unplugged-b624973a-ace1-47d7-8733-2a76e946eaec for instance with vm_state active and task_state rescuing.
Nov 07 04:00:53 user nova-compute[74540]: DEBUG nova.network.neutron [req-82538d5e-a15a-479b-a91b-f71db23f3e9c req-27592265-f049-4dff-81fa-2c7352d07a2b service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updated VIF entry in instance network info cache for port f821c840-d892-434e-a289-affbb1fd08b6. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:00:53 user nova-compute[74540]: DEBUG nova.network.neutron [req-82538d5e-a15a-479b-a91b-f71db23f3e9c req-27592265-f049-4dff-81fa-2c7352d07a2b service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [{"id": "f821c840-d892-434e-a289-affbb1fd08b6", "address": "fa:16:3e:36:80:ce", "network": {"id": "ddefaf54-73f2-48fa-9dd2-1c41aec51746", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1771812249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf821c840-d8", "ovs_interfaceid": "f821c840-d892-434e-a289-affbb1fd08b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "address": "fa:16:3e:22:ac:ce", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10c9e61-e2", "ovs_interfaceid": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:00:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-82538d5e-a15a-479b-a91b-f71db23f3e9c req-27592265-f049-4dff-81fa-2c7352d07a2b service nova] Releasing lock "refresh_cache-b0838704-02b2-4591-9d88-fe0dedcd8452" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:00:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Instance destroyed successfully.
Nov 07 04:00:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Attempting a stable device rescue
Nov 07 04:00:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74540) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 07 04:00:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Instance directory exists: not creating {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 04:00:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Creating image(s)
Nov 07 04:00:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "/opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "/opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:54 user nova-compute[74540]: DEBUG nova.objects.instance [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "cf9b503f00246873abd2ac0e0951c6269736f137" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "cf9b503f00246873abd2ac0e0951c6269736f137" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137.part --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137.part --force-share --output=json" returned: 0 in 0.209s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG nova.virt.images [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] 9b4aa67d-0e16-44c2-b1cc-d2414ee2c22f was qcow2, converting to raw {{(pid=74540) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137.part /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137.converted {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "d6098213-4199-4660-b36a-ea1908fa9ec8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-a152c33a-a3ab-4b7d-84a5-77d0ab291d86 req-904a3d06-7347-48f3-990b-73551215bd17 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a152c33a-a3ab-4b7d-84a5-77d0ab291d86 req-904a3d06-7347-48f3-990b-73551215bd17 service nova] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a152c33a-a3ab-4b7d-84a5-77d0ab291d86 req-904a3d06-7347-48f3-990b-73551215bd17 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a152c33a-a3ab-4b7d-84a5-77d0ab291d86 req-904a3d06-7347-48f3-990b-73551215bd17 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-a152c33a-a3ab-4b7d-84a5-77d0ab291d86 req-904a3d06-7347-48f3-990b-73551215bd17 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] No waiting events found dispatching network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:55 user nova-compute[74540]: WARNING nova.compute.manager [req-a152c33a-a3ab-4b7d-84a5-77d0ab291d86 req-904a3d06-7347-48f3-990b-73551215bd17 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received unexpected event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec for instance with vm_state active and task_state rescuing.
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:55 user nova-compute[74540]: INFO nova.compute.manager [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Terminating instance
Nov 07 04:00:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137.part /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137.converted" returned: 0 in 0.301s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137.converted --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:00:55 user nova-compute[74540]: INFO nova.compute.claims [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Claim successful on node user
Nov 07 04:00:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "cf9b503f00246873abd2ac0e0951c6269736f137" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.712s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "cf9b503f00246873abd2ac0e0951c6269736f137" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "cf9b503f00246873abd2ac0e0951c6269736f137" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137 --force-share --output=json" returned: 0 in 0.238s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137,backing_fmt=raw /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.rescue {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137,backing_fmt=raw /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.rescue" returned: 0 in 0.064s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "cf9b503f00246873abd2ac0e0951c6269736f137" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.objects.instance [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lazy-loading 'migration_context' on Instance uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.objects.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Object Instance<5a9f46b2-f47c-44a7-9e54-aa167d6c720a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Start _get_guest_xml network_info=[{"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "vif_mac": "fa:16:3e:72:c8:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9b4aa67d-0e16-44c2-b1cc-d2414ee2c22f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhWLADTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '5a9f46b2-f47c-44a7-9e54-aa167d6c720a', 'attached_at': '', 'detached_at': '', 'volume_id': '196b6636-9efd-4905-b7a2-36a457b6818d', 'serial': '196b6636-9efd-4905-b7a2-36a457b6818d'}, 'boot_index': None, 'attachment_id': '97454ef2-7d7d-44cf-882e-038042c41925', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.objects.instance [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lazy-loading 'resources' on Instance uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-9664d202-8fa0-452b-9cfe-2303d9181917 req-70be4747-97cf-4bbd-a478-06b01c47d4e7 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9664d202-8fa0-452b-9cfe-2303d9181917 req-70be4747-97cf-4bbd-a478-06b01c47d4e7 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9664d202-8fa0-452b-9cfe-2303d9181917 req-70be4747-97cf-4bbd-a478-06b01c47d4e7 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9664d202-8fa0-452b-9cfe-2303d9181917 req-70be4747-97cf-4bbd-a478-06b01c47d4e7 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-9664d202-8fa0-452b-9cfe-2303d9181917 req-70be4747-97cf-4bbd-a478-06b01c47d4e7 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-unplugged-f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-9664d202-8fa0-452b-9cfe-2303d9181917 req-70be4747-97cf-4bbd-a478-06b01c47d4e7 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-f821c840-d892-434e-a289-affbb1fd08b6 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.objects.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Object Instance<5a9f46b2-f47c-44a7-9e54-aa167d6c720a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.objects.instance [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lazy-loading 'numa_topology' on Instance uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.objects.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Object Instance<5a9f46b2-f47c-44a7-9e54-aa167d6c720a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:00:56 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:00:56 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.objects.instance [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.objects.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Object Instance<5a9f46b2-f47c-44a7-9e54-aa167d6c720a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhWLADTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:56 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:56 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:56 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d10a43-35a0-41e2-87fc-c54b223ee964]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fhWLADTM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 07 04:00:56 user nova-compute[74540]: node.name = iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:00:56 user nova-compute[74540]: node.tpgt = -1
Nov 07 04:00:56 user nova-compute[74540]: node.startup = automatic
Nov 07 04:00:56 user nova-compute[74540]: node.leading_login = No
Nov 07 04:00:56 user nova-compute[74540]: iface.iscsi_ifacename = default
Nov 07 04:00:56 user nova-compute[74540]: iface.net_ifacename = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.ipaddress = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.prefix_len = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.hwaddress = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.transport_name = tcp
Nov 07 04:00:56 user nova-compute[74540]: iface.initiatorname = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.state = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.vlan_id = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.vlan_priority = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.vlan_state = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.iface_num = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.mtu = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.port = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.bootproto = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.subnet_mask = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.gateway = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.dhcp_alt_client_id_state = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.dhcp_alt_client_id = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.dhcp_dns = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.dhcp_learn_iqn = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.dhcp_req_vendor_id_state = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.dhcp_vendor_id_state = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.dhcp_vendor_id = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.dhcp_slp_da = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.fragmentation = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.gratuitous_arp = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.incoming_forwarding = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.tos_state = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.tos = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.ttl = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.delayed_ack = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.tcp_nagle = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.tcp_wsf_state = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.tcp_wsf = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.tcp_timer_scale = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.tcp_timestamp = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.redirect = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.def_task_mgmt_timeout = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.header_digest = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.data_digest = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.immediate_data = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.initial_r2t = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.data_seq_inorder = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.data_pdu_inorder = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.erl = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.max_receive_data_len = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.first_burst_len = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.max_outstanding_r2t = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.max_burst_len = 0
Nov 07 04:00:56 user nova-compute[74540]: iface.chap_auth = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.bidi_chap = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.strict_login_compliance = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.discovery_auth = <empty>
Nov 07 04:00:56 user nova-compute[74540]: iface.discovery_logout = <empty>
Nov 07 04:00:56 user nova-compute[74540]: node.discovery_address = <empty>
Nov 07 04:00:56 user nova-compute[74540]: node.discovery_port = 0
Nov 07 04:00:56 user nova-compute[74540]: node.discovery_type = static
Nov 07 04:00:56 user nova-compute[74540]: node.session.initial_cmdsn = 0
Nov 07 04:00:56 user nova-compute[74540]: node.session.initial_login_retry_max = 8
Nov 07 04:00:56 user nova-compute[74540]: node.session.xmit_thread_priority = -20
Nov 07 04:00:56 user nova-compute[74540]: node.session.cmds_max = 128
Nov 07 04:00:56 user nova-compute[74540]: node.session.queue_depth = 32
Nov 07 04:00:56 user nova-compute[74540]: node.session.nr_sessions = 1
Nov 07 04:00:56 user nova-compute[74540]: node.session.auth.authmethod = CHAP
Nov 07 04:00:56 user nova-compute[74540]: node.session.auth.username = fhWLADTM
Nov 07 04:00:56 user nova-compute[74540]: node.session.auth.password = ***
Nov 07 04:00:56 user nova-compute[74540]: node.session.auth.username_in = <empty>
Nov 07 04:00:56 user nova-compute[74540]: node.session.auth.password_in = <empty>
Nov 07 04:00:56 user nova-compute[74540]: node.session.auth.chap_algs = MD5
Nov 07 04:00:56 user nova-compute[74540]: node.session.timeo.replacement_timeout = 120
Nov 07 04:00:56 user nova-compute[74540]: node.session.err_timeo.abort_timeout = 15
Nov 07 04:00:56 user nova-compute[74540]: node.session.err_timeo.lu_reset_timeout = 30
Nov 07 04:00:56 user nova-compute[74540]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 07 04:00:56 user nova-compute[74540]: node.session.err_timeo.host_reset_timeout = 60
Nov 07 04:00:56 user nova-compute[74540]: node.session.iscsi.FastAbort = Yes
Nov 07 04:00:56 user nova-compute[74540]: node.session.iscsi.InitialR2T = No
Nov 07 04:00:56 user nova-compute[74540]: node.session.iscsi.ImmediateData = Yes
Nov 07 04:00:56 user nova-compute[74540]: node.session.iscsi.FirstBurstLength = 262144
Nov 07 04:00:56 user nova-compute[74540]: node.session.iscsi.MaxBurstLength = 16776192
Nov 07 04:00:56 user nova-compute[74540]: node.session.iscsi.DefaultTime2Retain = 0
Nov 07 04:00:56 user nova-compute[74540]: node.session.iscsi.DefaultTime2Wait = 2
Nov 07 04:00:56 user nova-compute[74540]: node.session.iscsi.MaxConnections = 1
Nov 07 04:00:56 user nova-compute[74540]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 07 04:00:56 user nova-compute[74540]: node.session.iscsi.ERL = 0
Nov 07 04:00:56 user nova-compute[74540]: node.session.scan = manual
Nov 07 04:00:56 user nova-compute[74540]: node.session.reopen_max = 0
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].address = 172.16.0.220
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].port = 3260
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].startup = manual
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].tcp.window_size = 524288
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].tcp.type_of_service = 0
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].timeo.logout_timeout = 15
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].timeo.login_timeout = 15
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].timeo.auth_timeout = 45
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].timeo.noop_out_interval = 5
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].timeo.noop_out_timeout = 5
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].iscsi.HeaderDigest = None
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].iscsi.DataDigest = None
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].iscsi.IFMarker = No
Nov 07 04:00:56 user nova-compute[74540]: node.conn[0].iscsi.OFMarker = No
Nov 07 04:00:56 user nova-compute[74540]: # END RECORD
Nov 07 04:00:56 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7dd751-6340-474d-83ac-f15c1d903205]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0966de0-c2db-4498-9825-38a61794e12f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhWLADTM {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fhWLADTM" returned: 0 in 0.034s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c517c36-1458-4986-9220-a4248cd708d2]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fhWLADTM'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de50cbd-01ab-4c1d-9271-31a26bea7959]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfaed2a-7d24-45a8-8abd-dda23b4fd74d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:56 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:56 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:56 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] HCTL ('38', '0', '0', 0) found on session 15 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-d859d722-05ba-466e-b2c7-1ffe19ab72ec req-ba0e5c41-97a4-4f8e-bedf-68841e7e0a96 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d859d722-05ba-466e-b2c7-1ffe19ab72ec req-ba0e5c41-97a4-4f8e-bedf-68841e7e0a96 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d859d722-05ba-466e-b2c7-1ffe19ab72ec req-ba0e5c41-97a4-4f8e-bedf-68841e7e0a96 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d859d722-05ba-466e-b2c7-1ffe19ab72ec req-ba0e5c41-97a4-4f8e-bedf-68841e7e0a96 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-d859d722-05ba-466e-b2c7-1ffe19ab72ec req-ba0e5c41-97a4-4f8e-bedf-68841e7e0a96 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-unplugged-b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-d859d722-05ba-466e-b2c7-1ffe19ab72ec req-ba0e5c41-97a4-4f8e-bedf-68841e7e0a96 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-b806d809-0e35-4345-8665-d3e15ad73b59 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ddb92e-2ed9-4f3f-a20c-cafdb8488079]: (4, ('0 0 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Searching for a device in session 15 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhWLADTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.292s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] <== connect_volume: return (293ms) {'type': 'block', 'scsi_wwn': '26531623039616462', 'path': '/dev/sdg'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531623039616462', 'path': '/dev/sdg'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-270406895',display_name='tempest-ServerStableDeviceRescueTest-server-270406895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-270406895',id=3,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB73hKr0rCSaXcEdzAIV9bdsU5+khQO/C1hkKjkqXTy7pwY3QiFu4j8idpqpU2PBgsUP2QTfIFzopN/poLcBVGh0/WKe94Lh0RtHcChTpf0rxWKgCmEpAp0beMT3frmJpw==',key_name='tempest-keypair-672410008',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f20cf66849de49ce9591749b8a941d76',ramdisk_id='',reservation_id='r-ok1nm0rk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-700722702',owner_user_name='tempest-ServerStableDeviceRescueTest-700722702-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1aae6f239de4d6994efd7eace1ceecc',uuid=5a9f46b2-f47c-44a7-9e54-aa167d6c720a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "vif_mac": "fa:16:3e:72:c8:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Converting VIF {"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "vif_mac": "fa:16:3e:72:c8:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:c8:7f,bridge_name='br-int',has_traffic_filtering=True,id=b624973a-ace1-47d7-8733-2a76e946eaec,network=Network(930b8cda-0528-4954-9f89-52be884a19fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624973a-ac') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.objects.instance [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.objects.base [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Object Instance<5a9f46b2-f47c-44a7-9e54-aa167d6c720a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:00:56 user nova-compute[74540]:   <uuid>5a9f46b2-f47c-44a7-9e54-aa167d6c720a</uuid>
Nov 07 04:00:56 user nova-compute[74540]:   <name>instance-00000003</name>
Nov 07 04:00:56 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:00:56 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:00:56 user nova-compute[74540]:   <metadata>
Nov 07 04:00:56 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:00:56 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:00:56 user nova-compute[74540]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-270406895</nova:name>
Nov 07 04:00:56 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:00:56</nova:creationTime>
Nov 07 04:00:56 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:00:56 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:00:56 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:00:56 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:00:56 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:00:56 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:00:56 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:00:56 user nova-compute[74540]:       <nova:owner>
Nov 07 04:00:56 user nova-compute[74540]:         <nova:user uuid="f1aae6f239de4d6994efd7eace1ceecc">tempest-ServerStableDeviceRescueTest-700722702-project-member</nova:user>
Nov 07 04:00:56 user nova-compute[74540]:         <nova:project uuid="f20cf66849de49ce9591749b8a941d76">tempest-ServerStableDeviceRescueTest-700722702</nova:project>
Nov 07 04:00:56 user nova-compute[74540]:       </nova:owner>
Nov 07 04:00:56 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:00:56 user nova-compute[74540]:       <nova:ports>
Nov 07 04:00:56 user nova-compute[74540]:         <nova:port uuid="b624973a-ace1-47d7-8733-2a76e946eaec">
Nov 07 04:00:56 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 04:00:56 user nova-compute[74540]:         </nova:port>
Nov 07 04:00:56 user nova-compute[74540]:       </nova:ports>
Nov 07 04:00:56 user nova-compute[74540]:     </nova:instance>
Nov 07 04:00:56 user nova-compute[74540]:   </metadata>
Nov 07 04:00:56 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:00:56 user nova-compute[74540]:     <system>
Nov 07 04:00:56 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:00:56 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:00:56 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:00:56 user nova-compute[74540]:       <entry name="serial">5a9f46b2-f47c-44a7-9e54-aa167d6c720a</entry>
Nov 07 04:00:56 user nova-compute[74540]:       <entry name="uuid">5a9f46b2-f47c-44a7-9e54-aa167d6c720a</entry>
Nov 07 04:00:56 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:00:56 user nova-compute[74540]:     </system>
Nov 07 04:00:56 user nova-compute[74540]:   </sysinfo>
Nov 07 04:00:56 user nova-compute[74540]:   <os>
Nov 07 04:00:56 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:00:56 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:00:56 user nova-compute[74540]:   </os>
Nov 07 04:00:56 user nova-compute[74540]:   <features>
Nov 07 04:00:56 user nova-compute[74540]:     <acpi/>
Nov 07 04:00:56 user nova-compute[74540]:     <apic/>
Nov 07 04:00:56 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:00:56 user nova-compute[74540]:   </features>
Nov 07 04:00:56 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:00:56 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:00:56 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:00:56 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:00:56 user nova-compute[74540]:   </clock>
Nov 07 04:00:56 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:00:56 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:00:56 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:00:56 user nova-compute[74540]:   </cpu>
Nov 07 04:00:56 user nova-compute[74540]:   <devices>
Nov 07 04:00:56 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:00:56 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:00:56 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk"/>
Nov 07 04:00:56 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:00:56 user nova-compute[74540]:     </disk>
Nov 07 04:00:56 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:00:56 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:56 user nova-compute[74540]:       <source dev="/dev/sdg"/>
Nov 07 04:00:56 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 04:00:56 user nova-compute[74540]:       <serial>196b6636-9efd-4905-b7a2-36a457b6818d</serial>
Nov 07 04:00:56 user nova-compute[74540]:     </disk>
Nov 07 04:00:56 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:00:56 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:00:56 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.rescue"/>
Nov 07 04:00:56 user nova-compute[74540]:       <target dev="vdc" bus="virtio"/>
Nov 07 04:00:56 user nova-compute[74540]:       <boot order="1"/>
Nov 07 04:00:56 user nova-compute[74540]:     </disk>
Nov 07 04:00:56 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:00:56 user nova-compute[74540]:       <mac address="fa:16:3e:72:c8:7f"/>
Nov 07 04:00:56 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:00:56 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:00:56 user nova-compute[74540]:       <target dev="tapb624973a-ac"/>
Nov 07 04:00:56 user nova-compute[74540]:     </interface>
Nov 07 04:00:56 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:00:56 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/console.log" append="off"/>
Nov 07 04:00:56 user nova-compute[74540]:     </serial>
Nov 07 04:00:56 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:00:56 user nova-compute[74540]:     <video>
Nov 07 04:00:56 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:00:56 user nova-compute[74540]:     </video>
Nov 07 04:00:56 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:00:56 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:00:56 user nova-compute[74540]:     </rng>
Nov 07 04:00:56 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:00:56 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:00:56 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:00:56 user nova-compute[74540]:     </memballoon>
Nov 07 04:00:56 user nova-compute[74540]:   </devices>
Nov 07 04:00:56 user nova-compute[74540]: </domain>
Nov 07 04:00:56 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.089s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Instance destroyed successfully.
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.network.neutron [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] No VIF found with MAC fa:16:3e:72:c8:7f, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:00:56 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:00:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.policy [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72436e7806974d159635dc3d86785dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22541886dbac4b43a412699358e12f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:00:57 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Creating image(s)
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "/opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "/opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.227s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-a0750b9d-bbac-490f-af0f-f4ca13768c3c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-unplugged-a0750b9d-bbac-490f-af0f-f4ca13768c3c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-a0750b9d-bbac-490f-af0f-f4ca13768c3c for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-a0750b9d-bbac-490f-af0f-f4ca13768c3c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-a0750b9d-bbac-490f-af0f-f4ca13768c3c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:57 user nova-compute[74540]: WARNING nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-a0750b9d-bbac-490f-af0f-f4ca13768c3c for instance with vm_state active and task_state deleting.
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-b211e9e5-243c-481c-bfef-6b3a9c532a3c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-unplugged-b211e9e5-243c-481c-bfef-6b3a9c532a3c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-b211e9e5-243c-481c-bfef-6b3a9c532a3c for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-b211e9e5-243c-481c-bfef-6b3a9c532a3c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-b211e9e5-243c-481c-bfef-6b3a9c532a3c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:57 user nova-compute[74540]: WARNING nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-b211e9e5-243c-481c-bfef-6b3a9c532a3c for instance with vm_state active and task_state deleting.
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-unplugged-9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9fa3adde-7eea-4e21-bf1e-8eb5cc2b1527 req-418764c9-c566-4206-ab77-1930843e63cd service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-9254f39e-f860-47d2-b274-12d409c79d83 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk 1073741824" returned: 0 in 0.097s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSskdBKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:57 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:57 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:57 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b30eea-b687-420f-a370-2d6483734846]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:00:57 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.035s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c5c9e9-ab35-45fd-a4f5-562aed770b58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8] added
Nov 07 04:00:57 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b6088b-c367-4cb7-901c-2c556ad025f5]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[002bcdf3-1a62-4eb8-bd62-5a556ac95ba4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSskdBKW {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.278s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:00:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSskdBKW" returned: 0 in 0.042s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1a39f3-1062-460b-b4c7-dd6aedc80e73]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uSskdBKW'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d91e61a-da41-4ecf-a27e-9b3d19282ac1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Successfully created port: 4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:00:58 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Instance destroyed successfully.
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.objects.instance [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lazy-loading 'resources' on Instance uuid b0838704-02b2-4591-9d88-fe0dedcd8452 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1912d4-e471-458c-9fb2-d6cb72790a1f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f821c840-d892-434e-a289-affbb1fd08b6", "address": "fa:16:3e:36:80:ce", "network": {"id": "ddefaf54-73f2-48fa-9dd2-1c41aec51746", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1771812249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf821c840-d8", "ovs_interfaceid": "f821c840-d892-434e-a289-affbb1fd08b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "f821c840-d892-434e-a289-affbb1fd08b6", "address": "fa:16:3e:36:80:ce", "network": {"id": "ddefaf54-73f2-48fa-9dd2-1c41aec51746", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1771812249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf821c840-d8", "ovs_interfaceid": "f821c840-d892-434e-a289-affbb1fd08b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=f821c840-d892-434e-a289-affbb1fd08b6,network=Network(ddefaf54-73f2-48fa-9dd2-1c41aec51746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf821c840-d8') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=f821c840-d892-434e-a289-affbb1fd08b6,network=Network(ddefaf54-73f2-48fa-9dd2-1c41aec51746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf821c840-d8') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf821c840-d8, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=498fe82b-8df8-4894-8d4f-d6cdbaa11b54) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Cannot resize image /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Ensure instance console log exists: /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.134s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e62922-7c0b-4b25-aaff-899f12c63f26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260]
Nov 07 04:00:58 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:58 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-b02533fa-9a87-48eb-96ca-f9d504945c3c req-78ce8247-deb6-4b86-a5b8-703aaae65bf4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b02533fa-9a87-48eb-96ca-f9d504945c3c req-78ce8247-deb6-4b86-a5b8-703aaae65bf4 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b02533fa-9a87-48eb-96ca-f9d504945c3c req-78ce8247-deb6-4b86-a5b8-703aaae65bf4 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b02533fa-9a87-48eb-96ca-f9d504945c3c req-78ce8247-deb6-4b86-a5b8-703aaae65bf4 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-b02533fa-9a87-48eb-96ca-f9d504945c3c req-78ce8247-deb6-4b86-a5b8-703aaae65bf4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:58 user nova-compute[74540]: WARNING nova.compute.manager [req-b02533fa-9a87-48eb-96ca-f9d504945c3c req-78ce8247-deb6-4b86-a5b8-703aaae65bf4 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-f821c840-d892-434e-a289-affbb1fd08b6 for instance with vm_state active and task_state deleting.
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7399cd8-d548-4a21-baf8-68cdbc2e1e1c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:58 user nova-compute[74540]: INFO os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=f821c840-d892-434e-a289-affbb1fd08b6,network=Network(ddefaf54-73f2-48fa-9dd2-1c41aec51746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf821c840-d8')
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ba:2d,bridge_name='br-int',has_traffic_filtering=True,id=a0750b9d-bbac-490f-af0f-f4ca13768c3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0750b9d-bb') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ba:2d,bridge_name='br-int',has_traffic_filtering=True,id=a0750b9d-bbac-490f-af0f-f4ca13768c3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0750b9d-bb') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0750b9d-bb, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8349a6fd-eb81-4818-a5c4-1bdfaf59b2b8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:58 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:58 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.533s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] HCTL ('41', '-', '-', 0) found on session 16 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a76f6181-b33b-4e36-9dff-9e95e848cd88) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d0429b-01e9-4099-b42a-a1d0377aaca3]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Searching for a device in session 16 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSskdBKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: INFO os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ba:2d,bridge_name='br-int',has_traffic_filtering=True,id=a0750b9d-bbac-490f-af0f-f4ca13768c3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa0750b9d-bb')
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:10:3d,bridge_name='br-int',has_traffic_filtering=True,id=b211e9e5-243c-481c-bfef-6b3a9c532a3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb211e9e5-24') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:10:3d,bridge_name='br-int',has_traffic_filtering=True,id=b211e9e5-243c-481c-bfef-6b3a9c532a3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb211e9e5-24') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb211e9e5-24, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66950c7c-0b81-4d0e-bd9e-0d92683f9374) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: INFO os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:10:3d,bridge_name='br-int',has_traffic_filtering=True,id=b211e9e5-243c-481c-bfef-6b3a9c532a3c,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb211e9e5-24')
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:54,bridge_name='br-int',has_traffic_filtering=True,id=b806d809-0e35-4345-8665-d3e15ad73b59,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806d809-0e') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:54,bridge_name='br-int',has_traffic_filtering=True,id=b806d809-0e35-4345-8665-d3e15ad73b59,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806d809-0e') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb806d809-0e, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d770c119-acd2-4b62-a7c0-31a737162de8) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:58 user nova-compute[74540]: WARNING nova.compute.manager [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-b806d809-0e35-4345-8665-d3e15ad73b59 for instance with vm_state active and task_state deleting.
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-unplugged-f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-f10c9e61-e28f-4432-b85e-a91c1a205b1a for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:58 user nova-compute[74540]: WARNING nova.compute.manager [req-4b2e56c5-8275-4e83-a3e3-5846dd60695e req-c6841d6f-cde2-42ef-8bfc-156691d5d8c6 service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-f10c9e61-e28f-4432-b85e-a91c1a205b1a for instance with vm_state active and task_state deleting.
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: INFO os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:54:54,bridge_name='br-int',has_traffic_filtering=True,id=b806d809-0e35-4345-8665-d3e15ad73b59,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb806d809-0e')
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=9254f39e-f860-47d2-b274-12d409c79d83,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9254f39e-f8') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=9254f39e-f860-47d2-b274-12d409c79d83,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9254f39e-f8') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9254f39e-f8, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f65167f-eaac-4d8d-92ee-de138baf8577) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Successfully updated port: 4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: INFO os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:4d:2d,bridge_name='br-int',has_traffic_filtering=True,id=9254f39e-f860-47d2-b274-12d409c79d83,network=Network(ab7212fd-9369-4b13-865b-07d6671d3320),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9254f39e-f8')
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "address": "fa:16:3e:22:ac:ce", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10c9e61-e2", "ovs_interfaceid": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "address": "fa:16:3e:22:ac:ce", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10c9e61-e2", "ovs_interfaceid": "f10c9e61-e28f-4432-b85e-a91c1a205b1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=f10c9e61-e28f-4432-b85e-a91c1a205b1a,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10c9e61-e2') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=f10c9e61-e28f-4432-b85e-a91c1a205b1a,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10c9e61-e2') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf10c9e61-e2, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "refresh_cache-d6098213-4199-4660-b36a-ea1908fa9ec8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquired lock "refresh_cache-d6098213-4199-4660-b36a-ea1908fa9ec8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf96937c-4e58-494f-a9b7-a6ab1cad6f42) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: INFO os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=f10c9e61-e28f-4432-b85e-a91c1a205b1a,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10c9e61-e2')
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-562296522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-562296522',id=11,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRT4V6b0DORfInaFviXwe7okMzZ/LX6CinzHSPM2Fwdv867RE1yJvbCgLGLYTBAFULmpUFMhRlWfe1bW2WXCkRJtp9ACpVgsJRZxNks4w/fn8Nhq0OaEaEqywW7VNALfg==',key_name='tempest-keypair-204877391',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='663e196e8d464d188e5e5dfbf8965da7',ramdisk_id='',reservation_id='r-r976toeu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1787786945',owner_user_name='tempest-TaggedBootDevicesTest-1787786945-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8307342a3838409c842e44cdea7d9e79',uuid=b0838704-02b2-4591-9d88-fe0dedcd8452,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converting VIF {"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:c1:4b,bridge_name='br-int',has_traffic_filtering=True,id=18407b84-616b-4e09-98f0-1fe082ecd8ec,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18407b84-61') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:c1:4b,bridge_name='br-int',has_traffic_filtering=True,id=18407b84-616b-4e09-98f0-1fe082ecd8ec,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18407b84-61') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18407b84-61, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d975e80b-fb98-4bff-a52d-773a3a27d59b) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:58 user nova-compute[74540]: INFO os_vif [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:c1:4b,bridge_name='br-int',has_traffic_filtering=True,id=18407b84-616b-4e09-98f0-1fe082ecd8ec,network=Network(ff37e26e-7d6c-455b-b1dd-f812b007647f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18407b84-61')
Nov 07 04:00:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GAFfKovn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:58 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.network.neutron [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Updating instance_info_cache with network_info: [{"id": "4f81041f-3336-4182-95a4-95d2fc406e96", "address": "fa:16:3e:5a:ce:f5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f81041f-33", "ovs_interfaceid": "4f81041f-3336-4182-95a4-95d2fc406e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Releasing lock "refresh_cache-d6098213-4199-4660-b36a-ea1908fa9ec8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.compute.manager [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Instance network_info: |[{"id": "4f81041f-3336-4182-95a4-95d2fc406e96", "address": "fa:16:3e:5a:ce:f5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f81041f-33", "ovs_interfaceid": "4f81041f-3336-4182-95a4-95d2fc406e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Start _get_guest_xml network_info=[{"id": "4f81041f-3336-4182-95a4-95d2fc406e96", "address": "fa:16:3e:5a:ce:f5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f81041f-33", "ovs_interfaceid": "4f81041f-3336-4182-95a4-95d2fc406e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:00:59 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:00:59 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1188154359',display_name='tempest-VolumesAdminNegativeTest-server-1188154359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1188154359',id=14,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22541886dbac4b43a412699358e12f25',ramdisk_id='',reservation_id='r-awszjm3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1758788930',owner_user_name='tempest-VolumesAdminNegativeTest-1758788930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:00:57Z,user_data=None,user_id='72436e7806974d159635dc3d86785dff',uuid=d6098213-4199-4660-b36a-ea1908fa9ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f81041f-3336-4182-95a4-95d2fc406e96", "address": "fa:16:3e:5a:ce:f5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f81041f-33", "ovs_interfaceid": "4f81041f-3336-4182-95a4-95d2fc406e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Converting VIF {"id": "4f81041f-3336-4182-95a4-95d2fc406e96", "address": "fa:16:3e:5a:ce:f5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f81041f-33", "ovs_interfaceid": "4f81041f-3336-4182-95a4-95d2fc406e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:f5,bridge_name='br-int',has_traffic_filtering=True,id=4f81041f-3336-4182-95a4-95d2fc406e96,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f81041f-33') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.objects.instance [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lazy-loading 'pci_devices' on Instance uuid d6098213-4199-4660-b36a-ea1908fa9ec8 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:00:59 user nova-compute[74540]:   <uuid>d6098213-4199-4660-b36a-ea1908fa9ec8</uuid>
Nov 07 04:00:59 user nova-compute[74540]:   <name>instance-0000000e</name>
Nov 07 04:00:59 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:00:59 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:00:59 user nova-compute[74540]:   <metadata>
Nov 07 04:00:59 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:00:59 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:00:59 user nova-compute[74540]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1188154359</nova:name>
Nov 07 04:00:59 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:00:59</nova:creationTime>
Nov 07 04:00:59 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:00:59 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:00:59 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:00:59 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:00:59 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:00:59 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:00:59 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:00:59 user nova-compute[74540]:       <nova:owner>
Nov 07 04:00:59 user nova-compute[74540]:         <nova:user uuid="72436e7806974d159635dc3d86785dff">tempest-VolumesAdminNegativeTest-1758788930-project-member</nova:user>
Nov 07 04:00:59 user nova-compute[74540]:         <nova:project uuid="22541886dbac4b43a412699358e12f25">tempest-VolumesAdminNegativeTest-1758788930</nova:project>
Nov 07 04:00:59 user nova-compute[74540]:       </nova:owner>
Nov 07 04:00:59 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:00:59 user nova-compute[74540]:       <nova:ports>
Nov 07 04:00:59 user nova-compute[74540]:         <nova:port uuid="4f81041f-3336-4182-95a4-95d2fc406e96">
Nov 07 04:00:59 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:00:59 user nova-compute[74540]:         </nova:port>
Nov 07 04:00:59 user nova-compute[74540]:       </nova:ports>
Nov 07 04:00:59 user nova-compute[74540]:     </nova:instance>
Nov 07 04:00:59 user nova-compute[74540]:   </metadata>
Nov 07 04:00:59 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:00:59 user nova-compute[74540]:     <system>
Nov 07 04:00:59 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:00:59 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:00:59 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:00:59 user nova-compute[74540]:       <entry name="serial">d6098213-4199-4660-b36a-ea1908fa9ec8</entry>
Nov 07 04:00:59 user nova-compute[74540]:       <entry name="uuid">d6098213-4199-4660-b36a-ea1908fa9ec8</entry>
Nov 07 04:00:59 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:00:59 user nova-compute[74540]:     </system>
Nov 07 04:00:59 user nova-compute[74540]:   </sysinfo>
Nov 07 04:00:59 user nova-compute[74540]:   <os>
Nov 07 04:00:59 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:00:59 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:00:59 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:00:59 user nova-compute[74540]:   </os>
Nov 07 04:00:59 user nova-compute[74540]:   <features>
Nov 07 04:00:59 user nova-compute[74540]:     <acpi/>
Nov 07 04:00:59 user nova-compute[74540]:     <apic/>
Nov 07 04:00:59 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:00:59 user nova-compute[74540]:   </features>
Nov 07 04:00:59 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:00:59 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:00:59 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:00:59 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:00:59 user nova-compute[74540]:   </clock>
Nov 07 04:00:59 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:00:59 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:00:59 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:00:59 user nova-compute[74540]:   </cpu>
Nov 07 04:00:59 user nova-compute[74540]:   <devices>
Nov 07 04:00:59 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:00:59 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:00:59 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk"/>
Nov 07 04:00:59 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:00:59 user nova-compute[74540]:     </disk>
Nov 07 04:00:59 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:00:59 user nova-compute[74540]:       <mac address="fa:16:3e:5a:ce:f5"/>
Nov 07 04:00:59 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:00:59 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:00:59 user nova-compute[74540]:       <target dev="tap4f81041f-33"/>
Nov 07 04:00:59 user nova-compute[74540]:     </interface>
Nov 07 04:00:59 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:00:59 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/console.log" append="off"/>
Nov 07 04:00:59 user nova-compute[74540]:     </serial>
Nov 07 04:00:59 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:00:59 user nova-compute[74540]:     <video>
Nov 07 04:00:59 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:00:59 user nova-compute[74540]:     </video>
Nov 07 04:00:59 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:00:59 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:00:59 user nova-compute[74540]:     </rng>
Nov 07 04:00:59 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:00:59 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:00:59 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:00:59 user nova-compute[74540]:     </memballoon>
Nov 07 04:00:59 user nova-compute[74540]:   </devices>
Nov 07 04:00:59 user nova-compute[74540]: </domain>
Nov 07 04:00:59 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1188154359',display_name='tempest-VolumesAdminNegativeTest-server-1188154359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1188154359',id=14,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22541886dbac4b43a412699358e12f25',ramdisk_id='',reservation_id='r-awszjm3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1758788930',owner_user_name='tempest-VolumesAdminNegativeTest-1758788930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:00:57Z,user_data=None,user_id='72436e7806974d159635dc3d86785dff',uuid=d6098213-4199-4660-b36a-ea1908fa9ec8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f81041f-3336-4182-95a4-95d2fc406e96", "address": "fa:16:3e:5a:ce:f5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f81041f-33", "ovs_interfaceid": "4f81041f-3336-4182-95a4-95d2fc406e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Converting VIF {"id": "4f81041f-3336-4182-95a4-95d2fc406e96", "address": "fa:16:3e:5a:ce:f5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f81041f-33", "ovs_interfaceid": "4f81041f-3336-4182-95a4-95d2fc406e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:f5,bridge_name='br-int',has_traffic_filtering=True,id=4f81041f-3336-4182-95a4-95d2fc406e96,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f81041f-33') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_vif [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:f5,bridge_name='br-int',has_traffic_filtering=True,id=4f81041f-3336-4182-95a4-95d2fc406e96,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f81041f-33') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9335525c-fb87-5678-ba55-54541d8b9335', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.607s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] <== connect_volume: return (1609ms) {'type': 'block', 'scsi_wwn': '23531343931393763', 'path': '/dev/sdj'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531343931393763', 'path': '/dev/sdj'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.454s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f81041f-33, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f81041f-33, col_values=(('qos', UUID('5d9a47a8-41b0-45ab-b411-6b83a11762c5')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f81041f-33, col_values=(('external_ids', {'iface-id': '4f81041f-3336-4182-95a4-95d2fc406e96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:ce:f5', 'vm-uuid': 'd6098213-4199-4660-b36a-ea1908fa9ec8'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lazy-loading 'flavor' on Instance uuid a3cae7a7-223c-438e-8206-39e0f1683cb0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:00:59 user nova-compute[74540]: INFO os_vif [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:f5,bridge_name='br-int',has_traffic_filtering=True,id=4f81041f-3336-4182-95a4-95d2fc406e96,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f81041f-33')
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e202ca0c-a3b7-4f2d-8c3a-0f073049478f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:00:59 user nova-compute[74540]: No targets found.
Nov 07 04:00:59 user nova-compute[74540]: iSNS:
Nov 07 04:00:59 user nova-compute[74540]: No targets found.
Nov 07 04:00:59 user nova-compute[74540]: STATIC:
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: FIRMWARE:
Nov 07 04:00:59 user nova-compute[74540]: No targets found.
Nov 07 04:00:59 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:00:59 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:00:59 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:00:59 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:00:59 user nova-compute[74540]:   <source dev="/dev/sdj"/>
Nov 07 04:00:59 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:00:59 user nova-compute[74540]:   <serial>615b5148-e91d-4c64-8ad2-084c8f7108e8</serial>
Nov 07 04:00:59 user nova-compute[74540]: </disk>
Nov 07 04:00:59 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ee75cc-fa66-47ee-bdf5-c075f25e5c82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] No VIF found with MAC fa:16:3e:5a:ce:f5, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a1367f-13ec-4c56-95a6-7f2785899e71]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc38e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03'): ({'sdd'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Removing single pathed devices sdd {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7084965c-6854-4556-94ec-a8f312582e98]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0b21bc-8f25-4d22-b551-ecf9add33e42]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Flushing IO for device /dev/sdd {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33c78db-90a7-42b8-af75-9e55244cfbdf]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a8d800-9c3d-44ca-a5bf-d2f43ffe09b2]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[37150136-7569-460a-a6f8-6ed4494e3d4a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:59 user nova-compute[74540]: WARNING nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-9254f39e-f860-47d2-b274-12d409c79d83 for instance with vm_state active and task_state deleting.
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-unplugged-18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-unplugged-18407b84-616b-4e09-98f0-1fe082ecd8ec for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-plugged-18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Acquiring lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] No waiting events found dispatching network-vif-plugged-18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:59 user nova-compute[74540]: WARNING nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received unexpected event network-vif-plugged-18407b84-616b-4e09-98f0-1fe082ecd8ec for instance with vm_state active and task_state deleting.
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] No waiting events found dispatching network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:59 user nova-compute[74540]: WARNING nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received unexpected event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec for instance with vm_state active and task_state rescuing.
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] No waiting events found dispatching network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:00:59 user nova-compute[74540]: WARNING nova.compute.manager [req-606e180a-d773-4df7-ae1a-bbab5ff9ba11 req-5065fc7b-1b84-484c-86a0-9db71b2022bf service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received unexpected event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec for instance with vm_state active and task_state rescuing.
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77053b3-36db-4b35-8067-f12e3df4b47f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03, portal: 172.16.0.220,3260]
Nov 07 04:00:59 user nova-compute[74540]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03, portal: 172.16.0.220,3260] successful.
Nov 07 04:00:59 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f2f4e21-0f8d-4d91-aef7-85a52ece7a03 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78d4725-7af1-40bf-977e-7269139830f1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.462s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] <== disconnect_volume: return (917ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgYBUqZc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:00:59 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e907c0f-38aa-46dc-b081-caa40cd3e9ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:00:59 user nova-compute[74540]: No targets found.
Nov 07 04:00:59 user nova-compute[74540]: iSNS:
Nov 07 04:00:59 user nova-compute[74540]: No targets found.
Nov 07 04:00:59 user nova-compute[74540]: STATIC:
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:00:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:00:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:00:59 user nova-compute[74540]: FIRMWARE:
Nov 07 04:00:59 user nova-compute[74540]: No targets found.
Nov 07 04:00:59 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:00:59 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:00:59 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[940f670a-5fc0-460e-a507-bd8aad423689]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3397effe-e8a7-4ec4-b295-e76c21ee379a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:00:59 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:00:59 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc38bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80'): ({'sde'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Removing single pathed devices sde {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6eed2cd-14f0-42fb-8c95-12dc5057f59a]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d7ffd6-1021-4b3a-b764-2113096ef585]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Flushing IO for device /dev/sde {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:00:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] No VIF found with MAC fa:16:3e:6b:66:f7, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[61436ef4-ff81-4d99-94d5-9bb70ebf320a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4223ed-47bd-4cab-afd9-1ba86aacf19d]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] SCSI volumes sde have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e3e242-0d3f-4d7d-b21b-aa16384b5be7]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7eb2368b-a247-4510-a83a-4f4c7cc67100 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.884s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c219ba1-57f6-40fd-9508-537580d3d939]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80, portal: 172.16.0.220,3260]
Nov 07 04:01:00 user nova-compute[74540]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80, portal: 172.16.0.220,3260] successful.
Nov 07 04:01:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e8ef321-04a2-4d5e-bee1-86329d4edc80 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[416a77f4-7708-4594-94fe-cf95180327d3]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] <== disconnect_volume: return (381ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXkwaKQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:01:00 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68bbc03-ce25-484f-a7e7-4d1f74dd2d13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:01:00 user nova-compute[74540]: No targets found.
Nov 07 04:01:00 user nova-compute[74540]: iSNS:
Nov 07 04:01:00 user nova-compute[74540]: No targets found.
Nov 07 04:01:00 user nova-compute[74540]: STATIC:
Nov 07 04:01:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:01:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:01:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace
Nov 07 04:01:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7
Nov 07 04:01:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:01:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:01:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:01:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:01:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:00 user nova-compute[74540]: FIRMWARE:
Nov 07 04:01:00 user nova-compute[74540]: No targets found.
Nov 07 04:01:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:01:00 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:01:00 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6860085-a0d4-47d5-9d24-4f36ac817661]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a182e6b9-6f9f-4e3a-a3bd-dc5bd48931bf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace (non-flash)
Nov 07 04:01:00 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc39f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace'): ({'sdf'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Removing single pathed devices sdf {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f2d7b9-bb01-40d6-b55d-f1920f4d0c34]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb48b21c-f6dd-4518-9906-7c095cddfd42]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Flushing IO for device /dev/sdf {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e991d0a0-3ced-439c-a376-e77fb770d4fb]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cd2559-c6ab-4434-8969-eefaf1384a3d]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] SCSI volumes sdf have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fdb2a0-0d1a-487e-99de-a78c70796f3b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cfa103-4507-494b-8229-5441b5c42bd4]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace, portal: 172.16.0.220,3260]
Nov 07 04:01:00 user nova-compute[74540]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace, portal: 172.16.0.220,3260] successful.
Nov 07 04:01:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a2c4da1-4612-463f-bae7-f82241cdbace -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4d1658-142b-4c7d-b863-e6cc408bc298]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] <== disconnect_volume: return (375ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:01:00 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Deleting instance files /opt/stack/data/nova/instances/b0838704-02b2-4591-9d88-fe0dedcd8452_del
Nov 07 04:01:00 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Deletion of /opt/stack/data/nova/instances/b0838704-02b2-4591-9d88-fe0dedcd8452_del complete
Nov 07 04:01:00 user nova-compute[74540]: INFO nova.compute.manager [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Took 5.13 seconds to destroy the instance on the hypervisor.
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-bd106a28-5e82-490d-8436-e20d87bd64a5 req-8f012fb2-8863-408f-a266-7bbedbd23ac9 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Received event network-changed-4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-bd106a28-5e82-490d-8436-e20d87bd64a5 req-8f012fb2-8863-408f-a266-7bbedbd23ac9 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Refreshing instance network info cache due to event network-changed-4f81041f-3336-4182-95a4-95d2fc406e96. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bd106a28-5e82-490d-8436-e20d87bd64a5 req-8f012fb2-8863-408f-a266-7bbedbd23ac9 service nova] Acquiring lock "refresh_cache-d6098213-4199-4660-b36a-ea1908fa9ec8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bd106a28-5e82-490d-8436-e20d87bd64a5 req-8f012fb2-8863-408f-a266-7bbedbd23ac9 service nova] Acquired lock "refresh_cache-d6098213-4199-4660-b36a-ea1908fa9ec8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:01:00 user nova-compute[74540]: DEBUG nova.network.neutron [req-bd106a28-5e82-490d-8436-e20d87bd64a5 req-8f012fb2-8863-408f-a266-7bbedbd23ac9 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Refreshing network info cache for port 4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:01:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:01 user nova-compute[74540]: DEBUG nova.network.neutron [req-bd106a28-5e82-490d-8436-e20d87bd64a5 req-8f012fb2-8863-408f-a266-7bbedbd23ac9 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Updated VIF entry in instance network info cache for port 4f81041f-3336-4182-95a4-95d2fc406e96. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:01:01 user nova-compute[74540]: DEBUG nova.network.neutron [req-bd106a28-5e82-490d-8436-e20d87bd64a5 req-8f012fb2-8863-408f-a266-7bbedbd23ac9 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Updating instance_info_cache with network_info: [{"id": "4f81041f-3336-4182-95a4-95d2fc406e96", "address": "fa:16:3e:5a:ce:f5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f81041f-33", "ovs_interfaceid": "4f81041f-3336-4182-95a4-95d2fc406e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bd106a28-5e82-490d-8436-e20d87bd64a5 req-8f012fb2-8863-408f-a266-7bbedbd23ac9 service nova] Releasing lock "refresh_cache-d6098213-4199-4660-b36a-ea1908fa9ec8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:01:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:01 user nova-compute[74540]: DEBUG nova.compute.manager [None req-550eed98-7d05-4026-902d-cec18fad5413 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:01:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Stashing vm_state: active {{(pid=74540) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 07 04:01:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-665dae5b-42d8-44c4-bb40-31d33be88041 req-20174705-858a-4645-aadf-7e3406846ff6 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Received event network-vif-plugged-4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-665dae5b-42d8-44c4-bb40-31d33be88041 req-20174705-858a-4645-aadf-7e3406846ff6 service nova] Acquiring lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-665dae5b-42d8-44c4-bb40-31d33be88041 req-20174705-858a-4645-aadf-7e3406846ff6 service nova] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-665dae5b-42d8-44c4-bb40-31d33be88041 req-20174705-858a-4645-aadf-7e3406846ff6 service nova] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-665dae5b-42d8-44c4-bb40-31d33be88041 req-20174705-858a-4645-aadf-7e3406846ff6 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] No waiting events found dispatching network-vif-plugged-4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:02 user nova-compute[74540]: WARNING nova.compute.manager [req-665dae5b-42d8-44c4-bb40-31d33be88041 req-20174705-858a-4645-aadf-7e3406846ff6 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Received unexpected event network-vif-plugged-4f81041f-3336-4182-95a4-95d2fc406e96 for instance with vm_state building and task_state spawning.
Nov 07 04:01:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-665dae5b-42d8-44c4-bb40-31d33be88041 req-20174705-858a-4645-aadf-7e3406846ff6 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Received event network-vif-plugged-4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-665dae5b-42d8-44c4-bb40-31d33be88041 req-20174705-858a-4645-aadf-7e3406846ff6 service nova] Acquiring lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-665dae5b-42d8-44c4-bb40-31d33be88041 req-20174705-858a-4645-aadf-7e3406846ff6 service nova] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-665dae5b-42d8-44c4-bb40-31d33be88041 req-20174705-858a-4645-aadf-7e3406846ff6 service nova] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-665dae5b-42d8-44c4-bb40-31d33be88041 req-20174705-858a-4645-aadf-7e3406846ff6 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] No waiting events found dispatching network-vif-plugged-4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:02 user nova-compute[74540]: WARNING nova.compute.manager [req-665dae5b-42d8-44c4-bb40-31d33be88041 req-20174705-858a-4645-aadf-7e3406846ff6 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Received unexpected event network-vif-plugged-4f81041f-3336-4182-95a4-95d2fc406e96 for instance with vm_state building and task_state spawning.
Nov 07 04:01:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:02 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:01:02 user nova-compute[74540]: INFO nova.compute.claims [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Claim successful on node user
Nov 07 04:01:02 user nova-compute[74540]: INFO nova.compute.resource_tracker [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating resource usage from migration f4a9c60a-8456-4e01-9930-f701674cbe09
Nov 07 04:01:03 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:01:03 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:01:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.969s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:03 user nova-compute[74540]: INFO nova.compute.manager [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Migrating
Nov 07 04:01:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:01:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:01:03 user nova-compute[74540]: INFO nova.compute.rpcapi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 07 04:01:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:01:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:01:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquired lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:01:03 user nova-compute[74540]: DEBUG nova.network.neutron [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.compute.manager [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:01:04 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Instance spawned successfully.
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.network.neutron [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating instance_info_cache with network_info: [{"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Releasing lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:01:04 user nova-compute[74540]: INFO nova.compute.manager [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Took 7.40 seconds to spawn the instance on the hypervisor.
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.compute.manager [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:01:04 user nova-compute[74540]: INFO nova.compute.manager [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Took 9.22 seconds to build instance.
Nov 07 04:01:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053ce4d7-b329-46b7-8d86-84e3f4f3775a tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.466s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-deleted-f10c9e61-e28f-4432-b85e-a91c1a205b1a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:04 user nova-compute[74540]: INFO nova.compute.manager [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Neutron deleted interface f10c9e61-e28f-4432-b85e-a91c1a205b1a; detaching it from the instance and deleting it from the info cache
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.network.neutron [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [{"id": "f821c840-d892-434e-a289-affbb1fd08b6", "address": "fa:16:3e:36:80:ce", "network": {"id": "ddefaf54-73f2-48fa-9dd2-1c41aec51746", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1771812249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf821c840-d8", "ovs_interfaceid": "f821c840-d892-434e-a289-affbb1fd08b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Starting migrate_disk_and_power_off {{(pid=74540) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Detach interface failed, port_id=f10c9e61-e28f-4432-b85e-a91c1a205b1a, reason: Instance b0838704-02b2-4591-9d88-fe0dedcd8452 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-deleted-f821c840-d892-434e-a289-affbb1fd08b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:04 user nova-compute[74540]: INFO nova.compute.manager [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Neutron deleted interface f821c840-d892-434e-a289-affbb1fd08b6; detaching it from the instance and deleting it from the info cache
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.network.neutron [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [{"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b806d809-0e35-4345-8665-d3e15ad73b59", "address": "fa:16:3e:10:54:54", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb806d809-0e", "ovs_interfaceid": "b806d809-0e35-4345-8665-d3e15ad73b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Detach interface failed, port_id=f821c840-d892-434e-a289-affbb1fd08b6, reason: Instance b0838704-02b2-4591-9d88-fe0dedcd8452 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-deleted-b806d809-0e35-4345-8665-d3e15ad73b59 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:04 user nova-compute[74540]: INFO nova.compute.manager [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Neutron deleted interface b806d809-0e35-4345-8665-d3e15ad73b59; detaching it from the instance and deleting it from the info cache
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.network.neutron [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [{"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9254f39e-f860-47d2-b274-12d409c79d83", "address": "fa:16:3e:93:4d:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9254f39e-f8", "ovs_interfaceid": "9254f39e-f860-47d2-b274-12d409c79d83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Detach interface failed, port_id=b806d809-0e35-4345-8665-d3e15ad73b59, reason: Instance b0838704-02b2-4591-9d88-fe0dedcd8452 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-deleted-9254f39e-f860-47d2-b274-12d409c79d83 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:04 user nova-compute[74540]: INFO nova.compute.manager [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Neutron deleted interface 9254f39e-f860-47d2-b274-12d409c79d83; detaching it from the instance and deleting it from the info cache
Nov 07 04:01:04 user nova-compute[74540]: DEBUG nova.network.neutron [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [{"id": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "address": "fa:16:3e:43:ba:2d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0750b9d-bb", "ovs_interfaceid": "a0750b9d-bbac-490f-af0f-f4ca13768c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "address": "fa:16:3e:42:10:3d", "network": {"id": "ab7212fd-9369-4b13-865b-07d6671d3320", "bridge": "br-int", "label": "tempest-device-tagging-net1-218548070", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.98", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb211e9e5-24", "ovs_interfaceid": "b211e9e5-243c-481c-bfef-6b3a9c532a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "address": "fa:16:3e:ea:c1:4b", "network": {"id": "ff37e26e-7d6c-455b-b1dd-f812b007647f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1738328724", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "663e196e8d464d188e5e5dfbf8965da7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18407b84-61", "ovs_interfaceid": "18407b84-616b-4e09-98f0-1fe082ecd8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-1581c75a-c909-46a7-84b4-f23f8b793a43 req-95f462f7-da8b-4ffd-b530-fd0ed044df4e service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Detach interface failed, port_id=9254f39e-f860-47d2-b274-12d409c79d83, reason: Instance b0838704-02b2-4591-9d88-fe0dedcd8452 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:05 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Took 4.66 seconds to deallocate network for instance.
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Acquiring lock "a78e9806-c043-437c-b085-108eee9a921b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "a78e9806-c043-437c-b085-108eee9a921b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Acquiring lock "a78e9806-c043-437c-b085-108eee9a921b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "a78e9806-c043-437c-b085-108eee9a921b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "a78e9806-c043-437c-b085-108eee9a921b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:05 user nova-compute[74540]: INFO nova.compute.manager [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Terminating instance
Nov 07 04:01:05 user nova-compute[74540]: DEBUG nova.compute.manager [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Instance destroyed successfully.
Nov 07 04:01:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1210052302',display_name='tempest-ServerActionsTestOtherB-server-1210052302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1210052302',id=4,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA4sa8gttNcUVG7dP3QNit/DgVEny+5q14Y5Nq4fULGEJH2XetZ4c/LpN/MeE1MeKbjuGhXIPyx37hOCdT8fI0kPAEfe6XDcs5qqFJVn5zBv9qgxSc44xeWnPbfk+DcLA==',key_name='tempest-keypair-1859375338',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ede989d4b3d34f1b996f135913039586',ramdisk_id='',reservation_id='r-kydyio2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-414073346',owner_user_name='tempest-ServerActionsTestOtherB-414073346-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:01:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0218f41629a9468f80011fb04e917600',uuid=a3cae7a7-223c-438e-8206-39e0f1683cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1299966827-network", "vif_mac": "fa:16:3e:6b:66:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converting VIF {"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1299966827-network", "vif_mac": "fa:16:3e:6b:66:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG os_vif [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27e96706-58, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a875d202-028f-4e69-bea1-5094c89069d0) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:05 user nova-compute[74540]: INFO os_vif [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58')
Nov 07 04:01:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSskdBKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:01:05 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:01:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[14351a92-57e1-4987-9b9a-64f51dd83aad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:01:05 user nova-compute[74540]: No targets found.
Nov 07 04:01:05 user nova-compute[74540]: iSNS:
Nov 07 04:01:05 user nova-compute[74540]: No targets found.
Nov 07 04:01:05 user nova-compute[74540]: STATIC:
Nov 07 04:01:05 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:01:05 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:05 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:05 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:01:05 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:05 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:05 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7
Nov 07 04:01:05 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:05 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:05 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:01:05 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:05 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:05 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:01:05 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:05 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:05 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:01:05 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:05 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:05 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:01:05 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:05 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:05 user nova-compute[74540]: FIRMWARE:
Nov 07 04:01:05 user nova-compute[74540]: No targets found.
Nov 07 04:01:05 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:01:05 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:01:05 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90893f3-c0f1-4d95-a8c2-3043bddae22c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb731c6-84e9-4439-a605-7727f542eee4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:05 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:05 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:05 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:05 user nova-compute[74540]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:05 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:05 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:05 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:05 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:05 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:05 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:05 user nova-compute[74540]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:05 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:05 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:05 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc3f5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8'): ({'sdj'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Removing single pathed devices sdj {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:01:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[773e24ec-2484-4372-a8f8-2478454b964b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a8a444-6c6e-4a05-bdec-3690ebdabb16]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Flushing IO for device /dev/sdj {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-4f80b986-a5bf-4fbc-9aa4-b7adb5782dc9 req-47d4fa17-c657-4228-88e1-b57a57379696 service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Received event network-vif-unplugged-88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4f80b986-a5bf-4fbc-9aa4-b7adb5782dc9 req-47d4fa17-c657-4228-88e1-b57a57379696 service nova] Acquiring lock "a78e9806-c043-437c-b085-108eee9a921b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4f80b986-a5bf-4fbc-9aa4-b7adb5782dc9 req-47d4fa17-c657-4228-88e1-b57a57379696 service nova] Lock "a78e9806-c043-437c-b085-108eee9a921b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4f80b986-a5bf-4fbc-9aa4-b7adb5782dc9 req-47d4fa17-c657-4228-88e1-b57a57379696 service nova] Lock "a78e9806-c043-437c-b085-108eee9a921b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-4f80b986-a5bf-4fbc-9aa4-b7adb5782dc9 req-47d4fa17-c657-4228-88e1-b57a57379696 service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] No waiting events found dispatching network-vif-unplugged-88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-4f80b986-a5bf-4fbc-9aa4-b7adb5782dc9 req-47d4fa17-c657-4228-88e1-b57a57379696 service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Received event network-vif-unplugged-88b714c9-dbce-4852-b4db-914aabf9b148 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f056236d-fba2-434c-8d57-a57064801fa0]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.063s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71c1df6-191f-462a-89ad-54da85332c4e]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] SCSI volumes sdj have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deaa8c8-8bae-4454-a23a-e34b5233dd5e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:06 user nova-compute[74540]: WARNING nova.compute.manager [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Timeout waiting for ['volume-reimaged-9edaab1d-3869-4da4-81e8-39c0bd9687a1'] for instance with vm_state active and task_state rebuilding. Event states are: volume-reimaged-9edaab1d-3869-4da4-81e8-39c0bd9687a1: timed out after 60.00 seconds: eventlet.timeout.Timeout: 60 seconds
Nov 07 04:01:06 user nova-compute[74540]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py:180: UserWarning: Cannot convert <Timeout at 0x7fedfc4531c0 seconds=60> to primitive, will raise ValueError instead of warning in version 3.0
Nov 07 04:01:06 user nova-compute[74540]:   warnings.warn("Cannot convert %r to primitive, will raise ValueError "
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.117s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7a3109-aed7-4293-81c8-520b5ea5a496]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260]
Nov 07 04:01:06 user nova-compute[74540]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260] successful.
Nov 07 04:01:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba68b570-3f39-4903-99c7-65171372d52d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.526s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] <== disconnect_volume: return (528ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: a78e9806-c043-437c-b085-108eee9a921b] Instance destroyed successfully.
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.objects.instance [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lazy-loading 'resources' on Instance uuid a78e9806-c043-437c-b085-108eee9a921b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-851480173',display_name='tempest-VolumesAssistedSnapshotsTest-server-851480173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-851480173',id=9,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpxrT9EAjhtY+XmZw3o43nhsipsxl87jFcZH7M3kAF1sOydZaPP99IOmn7Z6KpoyXK7gLdnCOQISHSZuMlV2njjuMwFVfg4Ds+3EcbWovoO/jY7+RMY3PCLNRZBsfpodQ==',key_name='tempest-keypair-2069609325',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:57:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90f8f90448fc46938fcbd7edd12a33f8',ramdisk_id='',reservation_id='r-46jja8vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-778897619',owner_user_name='tempest-VolumesAssistedSnapshotsTest-778897619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f1009e1abac41879d5560ca577f71cb',uuid=a78e9806-c043-437c-b085-108eee9a921b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88b714c9-dbce-4852-b4db-914aabf9b148", "address": "fa:16:3e:4a:39:9d", "network": {"id": "6476c0b5-57f3-4884-b30b-14a860ab605e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1311869783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f8f90448fc46938fcbd7edd12a33f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b714c9-db", "ovs_interfaceid": "88b714c9-dbce-4852-b4db-914aabf9b148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Converting VIF {"id": "88b714c9-dbce-4852-b4db-914aabf9b148", "address": "fa:16:3e:4a:39:9d", "network": {"id": "6476c0b5-57f3-4884-b30b-14a860ab605e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1311869783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90f8f90448fc46938fcbd7edd12a33f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88b714c9-db", "ovs_interfaceid": "88b714c9-dbce-4852-b4db-914aabf9b148", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:39:9d,bridge_name='br-int',has_traffic_filtering=True,id=88b714c9-dbce-4852-b4db-914aabf9b148,network=Network(6476c0b5-57f3-4884-b30b-14a860ab605e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b714c9-db') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG os_vif [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:39:9d,bridge_name='br-int',has_traffic_filtering=True,id=88b714c9-dbce-4852-b4db-914aabf9b148,network=Network(6476c0b5-57f3-4884-b30b-14a860ab605e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b714c9-db') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88b714c9-db, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b652b792-c858-4fba-846d-1680186b4ee7) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:06 user nova-compute[74540]: INFO os_vif [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:39:9d,bridge_name='br-int',has_traffic_filtering=True,id=88b714c9-dbce-4852-b4db-914aabf9b148,network=Network(6476c0b5-57f3-4884-b30b-14a860ab605e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88b714c9-db')
Nov 07 04:01:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Deleting instance files /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b_del
Nov 07 04:01:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Deletion of /opt/stack/data/nova/instances/a78e9806-c043-437c-b085-108eee9a921b_del complete
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:06 user nova-compute[74540]: INFO nova.compute.manager [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] [instance: a78e9806-c043-437c-b085-108eee9a921b] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: a78e9806-c043-437c-b085-108eee9a921b] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: a78e9806-c043-437c-b085-108eee9a921b] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0_resize/disk /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Received event network-vif-deleted-18407b84-616b-4e09-98f0-1fe082ecd8ec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-unplugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] No waiting events found dispatching network-vif-unplugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:06 user nova-compute[74540]: WARNING nova.compute.manager [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received unexpected event network-vif-unplugged-27e96706-586b-4c99-9b76-6073a1dda1c8 for instance with vm_state active and task_state resize_migrating.
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] No waiting events found dispatching network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:06 user nova-compute[74540]: WARNING nova.compute.manager [req-bdedd5f5-ba7e-4170-9ca0-9c5699b7814b req-a3339901-e1f7-4b24-88d1-9a7a7e95910c service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received unexpected event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 for instance with vm_state active and task_state resize_migrating.
Nov 07 04:01:07 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.767s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:07 user nova-compute[74540]: INFO nova.compute.manager [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Successfully reverted task state from rebuilding on failure for instance.
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server [None req-5b9473bf-3075-4418-9e1a-4384f10ba800 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Exception during message handling: ValueError: Circular reference detected
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3858, in rebuild_instance
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3944, in _do_rebuild_instance_with_claim
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4136, in _do_rebuild_instance
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3713, in _rebuild_default_impl
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self._rebuild_volume_backed_instance(
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3633, in _rebuild_volume_backed_instance
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with self.virtapi.wait_for_instance_event(instance, events,
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     next(self.gen)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 559, in wait_for_instance_event
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self._wait_for_instance_events(
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 471, in _wait_for_instance_events
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     actual_event = event.wait()
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 436, in wait
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     instance_event = self.event.wait()
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 125, in wait
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     result = hub.switch()
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 313, in switch
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return self.greenlet.switch()
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server eventlet.timeout.Timeout: 60 seconds
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server 
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server 
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1437, in decorated_function
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with EventReporter(context, event_name, host, instance_uuid,
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1400, in __exit__
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     objects.InstanceActionEvent.event_finish_with_failure(
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/base.py", line 393, in wrapper
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return fn.__get__(None, obj)(*args, **kwargs)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     result = cls.indirection_api.object_class_action_versions(
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return cctxt.call(context, 'object_class_action_versions',
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 190, in call
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     result = self.transport._send(
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     msg = rpc_common.serialize_msg(msg)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 292, in serialize_msg
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     _MESSAGE_KEY: jsonutils.dumps(raw_msg)}
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py", line 202, in dumps
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return json.dumps(obj, default=default, **kwargs)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/__init__.py", line 238, in dumps
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     **kw).encode(obj)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     chunks = self.iterencode(o, _one_shot=True)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return _iterencode(o, 0)
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server ValueError: Circular reference detected
Nov 07 04:01:07 user nova-compute[74540]: ERROR oslo_messaging.rpc.server 
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CMD "cp -r /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0_resize/disk /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk" returned: 0 in 0.553s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0_resize/disk.info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk.info {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CMD "cp -r /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0_resize/disk.info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk.info" returned: 0 in 0.060s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCfRSmPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5d248eae-ef06-4be3-9178-15d54309be59', 'attached_at': '', 'detached_at': '', 'volume_id': 'bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'serial': 'bef07b9d-ce1e-4543-abbd-ce125a6830e1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yANdbMsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '77f7f3b6-adbb-4908-b76d-f8a1a73200c7'}, 'status': 'reserved', 'instance': '5d248eae-ef06-4be3-9178-15d54309be59', 'attached_at': '', 'detached_at': '', 'volume_id': '77f7f3b6-adbb-4908-b76d-f8a1a73200c7', 'serial'} {{(pid=74540) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCfRSmPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:01:07 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:01:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:01:07 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:01:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:01:07 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1457d78d-59c0-4ee1-8c6c-d0dd1f626c04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:01:07 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.055s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9e6aa5-72e6-4550-96e5-1b0efa18e3b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1] added
Nov 07 04:01:07 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: a78e9806-c043-437c-b085-108eee9a921b] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f264f2-f619-4fc7-98fa-e16b533bbfd9]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:07 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: a78e9806-c043-437c-b085-108eee9a921b] Took 1.26 seconds to deallocate network for instance.
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60955c5-045d-488f-959d-d36103f90c70]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCfRSmPK {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCfRSmPK" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad1c274-aeef-4fb5-b95c-6acd15f0fdc3]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OCfRSmPK'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b9f712-be5a-4a8d-bc4f-52cf743c733f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa13a17-0cba-4e7b-9ed2-2a0a76230a95]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-80d28630-8425-471b-a510-19f943852318 req-dee2f4c7-cbf4-497b-bcf8-9580e6ec9155 service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Received event network-vif-plugged-88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-80d28630-8425-471b-a510-19f943852318 req-dee2f4c7-cbf4-497b-bcf8-9580e6ec9155 service nova] Acquiring lock "a78e9806-c043-437c-b085-108eee9a921b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-80d28630-8425-471b-a510-19f943852318 req-dee2f4c7-cbf4-497b-bcf8-9580e6ec9155 service nova] Lock "a78e9806-c043-437c-b085-108eee9a921b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-80d28630-8425-471b-a510-19f943852318 req-dee2f4c7-cbf4-497b-bcf8-9580e6ec9155 service nova] Lock "a78e9806-c043-437c-b085-108eee9a921b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-80d28630-8425-471b-a510-19f943852318 req-dee2f4c7-cbf4-497b-bcf8-9580e6ec9155 service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] No waiting events found dispatching network-vif-plugged-88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:08 user nova-compute[74540]: WARNING nova.compute.manager [req-80d28630-8425-471b-a510-19f943852318 req-dee2f4c7-cbf4-497b-bcf8-9580e6ec9155 service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Received unexpected event network-vif-plugged-88b714c9-dbce-4852-b4db-914aabf9b148 for instance with vm_state deleted and task_state None.
Nov 07 04:01:08 user nova-compute[74540]: DEBUG nova.network.neutron [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Port 27e96706-586b-4c99-9b76-6073a1dda1c8 binding to destination host user is already ACTIVE {{(pid=74540) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.118s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2910e6-5a18-4596-97d3-9004a0920761]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260]
Nov 07 04:01:08 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260] successful.
Nov 07 04:01:08 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce8d0dd-02fd-42af-92e2-bda8686a54f6]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0061cc-8aa9-457d-a89c-80cdc9a53d61]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:08 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:08 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e887f072-2f18-447e-983d-0d8c6e5d0796]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCfRSmPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquired lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG nova.network.neutron [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.665s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:08 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Deleted allocations for instance a78e9806-c043-437c-b085-108eee9a921b
Nov 07 04:01:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2ac37840-f40a-445d-948d-fba71781c260 tempest-VolumesAssistedSnapshotsTest-778897619 tempest-VolumesAssistedSnapshotsTest-778897619-project-member] Lock "a78e9806-c043-437c-b085-108eee9a921b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.497s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-7ede186c-7585-4296-9274-7f2f51b33ca5 req-40c2ba09-e071-4e9d-8118-0b339bb8a63a service nova] [instance: a78e9806-c043-437c-b085-108eee9a921b] Received event network-vif-deleted-88b714c9-dbce-4852-b4db-914aabf9b148 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG nova.network.neutron [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating instance_info_cache with network_info: [{"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Releasing lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG os_brick.utils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a735b50-1c76-4de6-a1e3-2de207b39793]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.538s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] <== connect_volume: return (1542ms) {'type': 'block', 'scsi_wwn': '23337303335366331', 'path': '/dev/sdd'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337303335366331', 'path': '/dev/sdd'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c61de86-5c1d-4bcb-9385-da01a9d2aeae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG nova.objects.instance [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lazy-loading 'flavor' on Instance uuid 5d248eae-ef06-4be3-9178-15d54309be59 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc748aa2-f265-4e6c-8ea5-0360bf10180f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8afe074-7685-49bd-989b-66e95a705eec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:09 user nova-compute[74540]: INFO nova.compute.manager [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] [instance: b0838704-02b2-4591-9d88-fe0dedcd8452] Took 4.11 seconds to detach 3 volumes for instance.
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:01:09 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e47bdc7-6d3b-4cf0-a176-b0621a9355eb]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG os_brick.utils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:01:10 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:01:10 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:01:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.783s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:10 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Deleted allocations for instance b0838704-02b2-4591-9d88-fe0dedcd8452
Nov 07 04:01:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Starting finish_migration {{(pid=74540) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 07 04:01:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Instance directory exists: not creating {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 04:01:10 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Creating image(s)
Nov 07 04:01:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-32813fd1-e4e3-4a9b-8dfb-372c0150223d tempest-TaggedBootDevicesTest-1787786945 tempest-TaggedBootDevicesTest-1787786945-project-member] Lock "b0838704-02b2-4591-9d88-fe0dedcd8452" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.028s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 141557760 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:01:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.263s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:10 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk. size=21474836480 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:01:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.356s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk 21474836480 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 256901120 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk 21474836480" returned: 0 in 0.324s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Ensure instance console log exists: /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Start _get_guest_xml network_info=[{"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1299966827-network", "vif_mac": "fa:16:3e:6b:66:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSskdBKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a3cae7a7-223c-438e-8206-39e0f1683cb0', 'attached_at': '2023-11-07T04:01:10.000000', 'detached_at': '', 'volume_id': '615b5148-e91d-4c64-8ad2-084c8f7108e8', 'serial': '615b5148-e91d-4c64-8ad2-084c8f7108e8'}, 'boot_index': None, 'attachment_id': 'dabf5098-6008-4f63-aa78-68ebd45b72a2', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:01:11 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:01:11 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSskdBKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:01:11 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:01:11 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:01:11 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:01:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[98435097-23c3-4cb3-bee4-02c51bcd695d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:01:11 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 355467264 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa21d9d-7a5d-4b07-8744-cc401f865dfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8] added
Nov 07 04:01:11 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69b2b11-5cc5-435b-bad4-87c41ce8fad9]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f287a484-f523-4446-9fc3-bf7861e134c1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSskdBKW {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSskdBKW" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30434f9-2f2c-4297-99df-f000e68a368c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uSskdBKW'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.045s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f37f5d-92ae-400c-9f3a-d7d01353b8d3]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e655e8-95a9-4beb-a256-8edfcc4aa014]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:11 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:11 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:11 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:11 user nova-compute[74540]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:01:11 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:11 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:11 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:11 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:11 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:11 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:11 user nova-compute[74540]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:01:11 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:11 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:11 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:01:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.143s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7878eab7-2416-4fae-a7e2-dcd7a0b33d5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260]
Nov 07 04:01:12 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260] successful.
Nov 07 04:01:12 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9957027d-df60-4056-9f2b-c0709b716776]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 473956352 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc40d7a-b185-4972-bcd7-818b9c2d1c4b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:12 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:12 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:12 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.558s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.032s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c60a1b9-1b11-4b33-bbc7-49fe4bea2005]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:01:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 611319808 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 768606208 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSskdBKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.611s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] <== connect_volume: return (1613ms) {'type': 'block', 'scsi_wwn': '23531343931393763', 'path': '/dev/sde'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531343931393763', 'path': '/dev/sde'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1210052302',display_name='tempest-ServerActionsTestOtherB-server-1210052302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1210052302',id=4,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA4sa8gttNcUVG7dP3QNit/DgVEny+5q14Y5Nq4fULGEJH2XetZ4c/LpN/MeE1MeKbjuGhXIPyx37hOCdT8fI0kPAEfe6XDcs5qqFJVn5zBv9qgxSc44xeWnPbfk+DcLA==',key_name='tempest-keypair-1859375338',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ede989d4b3d34f1b996f135913039586',ramdisk_id='',reservation_id='r-kydyio2y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-414073346',owner_user_name='tempest-ServerActionsTestOtherB-414073346-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0218f41629a9468f80011fb04e917600',uuid=a3cae7a7-223c-438e-8206-39e0f1683cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1299966827-network", "vif_mac": "fa:16:3e:6b:66:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converting VIF {"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1299966827-network", "vif_mac": "fa:16:3e:6b:66:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:01:13 user nova-compute[74540]:   <uuid>a3cae7a7-223c-438e-8206-39e0f1683cb0</uuid>
Nov 07 04:01:13 user nova-compute[74540]:   <name>instance-00000004</name>
Nov 07 04:01:13 user nova-compute[74540]:   <memory>2097152</memory>
Nov 07 04:01:13 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:01:13 user nova-compute[74540]:   <metadata>
Nov 07 04:01:13 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:01:13 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:01:13 user nova-compute[74540]:       <nova:name>tempest-ServerActionsTestOtherB-server-1210052302</nova:name>
Nov 07 04:01:13 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:01:11</nova:creationTime>
Nov 07 04:01:13 user nova-compute[74540]:       <nova:flavor name="m1.small">
Nov 07 04:01:13 user nova-compute[74540]:         <nova:memory>2048</nova:memory>
Nov 07 04:01:13 user nova-compute[74540]:         <nova:disk>20</nova:disk>
Nov 07 04:01:13 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:01:13 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:01:13 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:01:13 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:01:13 user nova-compute[74540]:       <nova:owner>
Nov 07 04:01:13 user nova-compute[74540]:         <nova:user uuid="0218f41629a9468f80011fb04e917600">tempest-ServerActionsTestOtherB-414073346-project-member</nova:user>
Nov 07 04:01:13 user nova-compute[74540]:         <nova:project uuid="ede989d4b3d34f1b996f135913039586">tempest-ServerActionsTestOtherB-414073346</nova:project>
Nov 07 04:01:13 user nova-compute[74540]:       </nova:owner>
Nov 07 04:01:13 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:01:13 user nova-compute[74540]:       <nova:ports>
Nov 07 04:01:13 user nova-compute[74540]:         <nova:port uuid="27e96706-586b-4c99-9b76-6073a1dda1c8">
Nov 07 04:01:13 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 07 04:01:13 user nova-compute[74540]:         </nova:port>
Nov 07 04:01:13 user nova-compute[74540]:       </nova:ports>
Nov 07 04:01:13 user nova-compute[74540]:     </nova:instance>
Nov 07 04:01:13 user nova-compute[74540]:   </metadata>
Nov 07 04:01:13 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:01:13 user nova-compute[74540]:     <system>
Nov 07 04:01:13 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:01:13 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:01:13 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:01:13 user nova-compute[74540]:       <entry name="serial">a3cae7a7-223c-438e-8206-39e0f1683cb0</entry>
Nov 07 04:01:13 user nova-compute[74540]:       <entry name="uuid">a3cae7a7-223c-438e-8206-39e0f1683cb0</entry>
Nov 07 04:01:13 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:01:13 user nova-compute[74540]:     </system>
Nov 07 04:01:13 user nova-compute[74540]:   </sysinfo>
Nov 07 04:01:13 user nova-compute[74540]:   <os>
Nov 07 04:01:13 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:01:13 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:01:13 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:01:13 user nova-compute[74540]:   </os>
Nov 07 04:01:13 user nova-compute[74540]:   <features>
Nov 07 04:01:13 user nova-compute[74540]:     <acpi/>
Nov 07 04:01:13 user nova-compute[74540]:     <apic/>
Nov 07 04:01:13 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:01:13 user nova-compute[74540]:   </features>
Nov 07 04:01:13 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:01:13 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:01:13 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:01:13 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:01:13 user nova-compute[74540]:   </clock>
Nov 07 04:01:13 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:01:13 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:01:13 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:01:13 user nova-compute[74540]:   </cpu>
Nov 07 04:01:13 user nova-compute[74540]:   <devices>
Nov 07 04:01:13 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:01:13 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:01:13 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk"/>
Nov 07 04:01:13 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:01:13 user nova-compute[74540]:     </disk>
Nov 07 04:01:13 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:01:13 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:01:13 user nova-compute[74540]:       <source dev="/dev/sde"/>
Nov 07 04:01:13 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 04:01:13 user nova-compute[74540]:       <serial>615b5148-e91d-4c64-8ad2-084c8f7108e8</serial>
Nov 07 04:01:13 user nova-compute[74540]:     </disk>
Nov 07 04:01:13 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:01:13 user nova-compute[74540]:       <mac address="fa:16:3e:6b:66:f7"/>
Nov 07 04:01:13 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:01:13 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:01:13 user nova-compute[74540]:       <target dev="tap27e96706-58"/>
Nov 07 04:01:13 user nova-compute[74540]:     </interface>
Nov 07 04:01:13 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:01:13 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/console.log" append="off"/>
Nov 07 04:01:13 user nova-compute[74540]:     </serial>
Nov 07 04:01:13 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:01:13 user nova-compute[74540]:     <video>
Nov 07 04:01:13 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:01:13 user nova-compute[74540]:     </video>
Nov 07 04:01:13 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:01:13 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:01:13 user nova-compute[74540]:     </rng>
Nov 07 04:01:13 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:01:13 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:01:13 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:01:13 user nova-compute[74540]:     </memballoon>
Nov 07 04:01:13 user nova-compute[74540]:   </devices>
Nov 07 04:01:13 user nova-compute[74540]: </domain>
Nov 07 04:01:13 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1210052302',display_name='tempest-ServerActionsTestOtherB-server-1210052302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1210052302',id=4,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA4sa8gttNcUVG7dP3QNit/DgVEny+5q14Y5Nq4fULGEJH2XetZ4c/LpN/MeE1MeKbjuGhXIPyx37hOCdT8fI0kPAEfe6XDcs5qqFJVn5zBv9qgxSc44xeWnPbfk+DcLA==',key_name='tempest-keypair-1859375338',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ede989d4b3d34f1b996f135913039586',ramdisk_id='',reservation_id='r-kydyio2y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-414073346',owner_user_name='tempest-ServerActionsTestOtherB-414073346-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0218f41629a9468f80011fb04e917600',uuid=a3cae7a7-223c-438e-8206-39e0f1683cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1299966827-network", "vif_mac": "fa:16:3e:6b:66:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converting VIF {"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1299966827-network", "vif_mac": "fa:16:3e:6b:66:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG os_vif [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fd51662-8103-509f-8fce-b6cb2ac043d4', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27e96706-58, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27e96706-58, col_values=(('qos', UUID('9ec8bf3b-2ba9-4a2b-9781-78afd0d1cfe4')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27e96706-58, col_values=(('external_ids', {'iface-id': '27e96706-586b-4c99-9b76-6073a1dda1c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:66:f7', 'vm-uuid': 'a3cae7a7-223c-438e-8206-39e0f1683cb0'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:13 user nova-compute[74540]: INFO os_vif [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58')
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] No VIF found with MAC fa:16:3e:6b:66:f7, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:01:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 877658112 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:01:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 1003487232 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:01:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yANdbMsr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '77f7f3b6-adbb-4908-b76d-f8a1a73200c7'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:01:15 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1835611-1c4c-43f4-a22d-18e209a90cdf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:01:15 user nova-compute[74540]: No targets found.
Nov 07 04:01:15 user nova-compute[74540]: iSNS:
Nov 07 04:01:15 user nova-compute[74540]: No targets found.
Nov 07 04:01:15 user nova-compute[74540]: STATIC:
Nov 07 04:01:15 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:01:15 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:15 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:15 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:01:15 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:15 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:15 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7
Nov 07 04:01:15 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:15 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:15 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:01:15 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:15 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:15 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:01:15 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:15 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:15 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:01:15 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:15 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:15 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1
Nov 07 04:01:15 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:15 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:15 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:01:15 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:15 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:15 user nova-compute[74540]: FIRMWARE:
Nov 07 04:01:15 user nova-compute[74540]: No targets found.
Nov 07 04:01:15 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:01:15 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:01:15 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ad5add-918c-49b7-abc9-8f17dc3140b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d77ec4-3bc0-40e8-b63b-338dcfc58c07]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:15 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:15 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:15 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee143cdf30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7'): ({'sdh'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Removing single pathed devices sdh {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c81a037-a56c-475c-8768-618957ff3641]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f47b19-aefd-4ff3-a2e7-96cf3603157a]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Flushing IO for device /dev/sdh {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75f6847-99e3-4dd2-ab0d-f55209a714ff]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7c9a46-3eaa-4a5c-913f-51be5e50031d]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] SCSI volumes sdh have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-63f48f94-39b0-4c46-a6aa-88683caf0309 req-1ffe712c-0718-4b44-8d0a-3e69ec2f4542 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-63f48f94-39b0-4c46-a6aa-88683caf0309 req-1ffe712c-0718-4b44-8d0a-3e69ec2f4542 service nova] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-63f48f94-39b0-4c46-a6aa-88683caf0309 req-1ffe712c-0718-4b44-8d0a-3e69ec2f4542 service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-63f48f94-39b0-4c46-a6aa-88683caf0309 req-1ffe712c-0718-4b44-8d0a-3e69ec2f4542 service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-63f48f94-39b0-4c46-a6aa-88683caf0309 req-1ffe712c-0718-4b44-8d0a-3e69ec2f4542 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] No waiting events found dispatching network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:15 user nova-compute[74540]: WARNING nova.compute.manager [req-63f48f94-39b0-4c46-a6aa-88683caf0309 req-1ffe712c-0718-4b44-8d0a-3e69ec2f4542 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received unexpected event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 for instance with vm_state active and task_state resize_finish.
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c31b12-e56f-448f-8743-14061684ffe1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc04174c-6d02-445d-94ae-a668443b5b47]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7, portal: 172.16.0.220,3260]
Nov 07 04:01:15 user nova-compute[74540]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7, portal: 172.16.0.220,3260] successful.
Nov 07 04:01:15 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77f7f3b6-adbb-4908-b76d-f8a1a73200c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef8a55f-1798-4b50-805f-72a4a44eb376]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.472s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] <== disconnect_volume: return (473ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCfRSmPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5d248eae-ef06-4be3-9178-15d54309be59', 'attached_at': '', 'detached_at': '', 'volume_id': 'bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'serial'} {{(pid=74540) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] swap_volume: removing Cinder connection for volume 77f7f3b6-adbb-4908-b76d-f8a1a73200c7 {{(pid=74540) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] swap_volume: Updating volume 77f7f3b6-adbb-4908-b76d-f8a1a73200c7 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "OCfRSmPK", "auth_password": "ofBgmIMAU2aGvr", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "bef07b9d-ce1e-4543-abbd-ce125a6830e1"}, "status": "reserved", "instance": "5d248eae-ef06-4be3-9178-15d54309be59", "attached_at": "", "detached_at": "", "volume_id": "bef07b9d-ce1e-4543-abbd-ce125a6830e1", "serial": "bef07b9d-ce1e-4543-abbd-ce125a6830e1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'no_device': None, 'attachment_id': 'd6a01768-2380-4974-910e-ff982cd4ac90'} {{(pid=74540) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 07 04:01:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6ce21104-3bb4-4421-bb30-fd6d2e7858e7 tempest-TestVolumeSwap-662652334 tempest-TestVolumeSwap-662652334-project-admin] Lock "5d248eae-ef06-4be3-9178-15d54309be59" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 38.439s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-3212ec92-1f0a-411d-9db6-997fb64af696 req-dfc94b67-26e2-46ef-ac7b-b35bdd4744f9 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3212ec92-1f0a-411d-9db6-997fb64af696 req-dfc94b67-26e2-46ef-ac7b-b35bdd4744f9 service nova] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3212ec92-1f0a-411d-9db6-997fb64af696 req-dfc94b67-26e2-46ef-ac7b-b35bdd4744f9 service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3212ec92-1f0a-411d-9db6-997fb64af696 req-dfc94b67-26e2-46ef-ac7b-b35bdd4744f9 service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-3212ec92-1f0a-411d-9db6-997fb64af696 req-dfc94b67-26e2-46ef-ac7b-b35bdd4744f9 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] No waiting events found dispatching network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:17 user nova-compute[74540]: WARNING nova.compute.manager [req-3212ec92-1f0a-411d-9db6-997fb64af696 req-dfc94b67-26e2-46ef-ac7b-b35bdd4744f9 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received unexpected event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 for instance with vm_state active and task_state resize_finish.
Nov 07 04:01:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:01:17 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Instance running successfully.
Nov 07 04:01:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Failed to set time: agent not configured {{(pid=74540) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 07 04:01:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d6172b0a-eea5-4851-a67d-1f1870c4d2a6 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] finish_migration finished successfully. {{(pid=74540) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 07 04:01:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "5d248eae-ef06-4be3-9178-15d54309be59" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "5d248eae-ef06-4be3-9178-15d54309be59" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:18 user nova-compute[74540]: INFO nova.compute.manager [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Detaching volume bef07b9d-ce1e-4543-abbd-ce125a6830e1
Nov 07 04:01:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:18 user nova-compute[74540]: INFO nova.virt.block_device [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Attempting to driver detach volume bef07b9d-ce1e-4543-abbd-ce125a6830e1 from mountpoint /dev/vdb
Nov 07 04:01:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Attempting to detach device vdb from instance 5d248eae-ef06-4be3-9178-15d54309be59 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:01:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:01:18 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:01:18 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:01:18 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:01:18 user nova-compute[74540]:   <serial>bef07b9d-ce1e-4543-abbd-ce125a6830e1</serial>
Nov 07 04:01:18 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:01:18 user nova-compute[74540]: </disk>
Nov 07 04:01:18 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:01:18 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Successfully detached device vdb from instance 5d248eae-ef06-4be3-9178-15d54309be59 from the persistent domain config.
Nov 07 04:01:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d248eae-ef06-4be3-9178-15d54309be59 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:01:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:01:18 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:01:18 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:01:18 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:01:18 user nova-compute[74540]:   <serial>bef07b9d-ce1e-4543-abbd-ce125a6830e1</serial>
Nov 07 04:01:18 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:01:18 user nova-compute[74540]: </disk>
Nov 07 04:01:18 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:01:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d248eae-ef06-4be3-9178-15d54309be59 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:01:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-6e402acb-8db7-463f-8e34-3f805b69cbb7 req-4a11ee59-3b0a-4d79-a569-8c0ac7686890 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Received event network-changed-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-6e402acb-8db7-463f-8e34-3f805b69cbb7 req-4a11ee59-3b0a-4d79-a569-8c0ac7686890 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Refreshing instance network info cache due to event network-changed-2531d2c8-bb10-4e14-a52b-7d7a5ec43153. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6e402acb-8db7-463f-8e34-3f805b69cbb7 req-4a11ee59-3b0a-4d79-a569-8c0ac7686890 service nova] Acquiring lock "refresh_cache-6679686b-b418-41ce-a160-97ec9df754c7" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6e402acb-8db7-463f-8e34-3f805b69cbb7 req-4a11ee59-3b0a-4d79-a569-8c0ac7686890 service nova] Acquired lock "refresh_cache-6679686b-b418-41ce-a160-97ec9df754c7" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG nova.network.neutron [req-6e402acb-8db7-463f-8e34-3f805b69cbb7 req-4a11ee59-3b0a-4d79-a569-8c0ac7686890 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Refreshing network info cache for port 2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "6679686b-b418-41ce-a160-97ec9df754c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "6679686b-b418-41ce-a160-97ec9df754c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "6679686b-b418-41ce-a160-97ec9df754c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "6679686b-b418-41ce-a160-97ec9df754c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "6679686b-b418-41ce-a160-97ec9df754c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:22 user nova-compute[74540]: INFO nova.compute.manager [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Terminating instance
Nov 07 04:01:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:22 user nova-compute[74540]: INFO nova.compute.manager [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Rescuing
Nov 07 04:01:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquired lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:01:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-6e402acb-8db7-463f-8e34-3f805b69cbb7 req-4a11ee59-3b0a-4d79-a569-8c0ac7686890 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Updated VIF entry in instance network info cache for port 2531d2c8-bb10-4e14-a52b-7d7a5ec43153. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-6e402acb-8db7-463f-8e34-3f805b69cbb7 req-4a11ee59-3b0a-4d79-a569-8c0ac7686890 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Updating instance_info_cache with network_info: [{"id": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "address": "fa:16:3e:48:14:19", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2531d2c8-bb", "ovs_interfaceid": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6e402acb-8db7-463f-8e34-3f805b69cbb7 req-4a11ee59-3b0a-4d79-a569-8c0ac7686890 service nova] Releasing lock "refresh_cache-6679686b-b418-41ce-a160-97ec9df754c7" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:23 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Instance destroyed successfully.
Nov 07 04:01:23 user nova-compute[74540]: DEBUG nova.objects.instance [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'resources' on Instance uuid 6679686b-b418-41ce-a160-97ec9df754c7 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1673303651',display_name='tempest-AttachVolumeNegativeTest-server-1673303651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1673303651',id=13,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF449I8qlQ3RJxhVgMTFsuiId0RBd22GExYKYlS/zqasFyMqY6v+2Q8x45Pi1ASOTTNMC1EHuLB2yB5jQu0pyavH9SoL9QzwQSMb0nVURc9u7MaYdrSoraP760KJHICDzw==',key_name='tempest-keypair-489856462',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='620cefdadcec49d6a696aa7db8cef2d1',ramdisk_id='',reservation_id='r-5rgot3uv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-306463361',owner_user_name='tempest-AttachVolumeNegativeTest-306463361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3079ba3a84ea4b4bb4a3e576ab4133ae',uuid=6679686b-b418-41ce-a160-97ec9df754c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "address": "fa:16:3e:48:14:19", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2531d2c8-bb", "ovs_interfaceid": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converting VIF {"id": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "address": "fa:16:3e:48:14:19", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2531d2c8-bb", "ovs_interfaceid": "2531d2c8-bb10-4e14-a52b-7d7a5ec43153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:14:19,bridge_name='br-int',has_traffic_filtering=True,id=2531d2c8-bb10-4e14-a52b-7d7a5ec43153,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2531d2c8-bb') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG os_vif [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:14:19,bridge_name='br-int',has_traffic_filtering=True,id=2531d2c8-bb10-4e14-a52b-7d7a5ec43153,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2531d2c8-bb') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2531d2c8-bb, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3931273-c6ab-4f4a-bc5f-080bee7e207b) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:23 user nova-compute[74540]: INFO os_vif [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:14:19,bridge_name='br-int',has_traffic_filtering=True,id=2531d2c8-bb10-4e14-a52b-7d7a5ec43153,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2531d2c8-bb')
Nov 07 04:01:23 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Deleting instance files /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7_del
Nov 07 04:01:23 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Deletion of /opt/stack/data/nova/instances/6679686b-b418-41ce-a160-97ec9df754c7_del complete
Nov 07 04:01:23 user nova-compute[74540]: DEBUG nova.network.neutron [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updating instance_info_cache with network_info: [{"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Releasing lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:01:23 user nova-compute[74540]: INFO nova.compute.manager [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 07 04:01:23 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-1b87199c-d9a2-4f2d-b472-f44c32e1c7f2 req-9837528a-f20a-4a89-b528-1eca66a8683b service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-unplugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1b87199c-d9a2-4f2d-b472-f44c32e1c7f2 req-9837528a-f20a-4a89-b528-1eca66a8683b service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1b87199c-d9a2-4f2d-b472-f44c32e1c7f2 req-9837528a-f20a-4a89-b528-1eca66a8683b service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1b87199c-d9a2-4f2d-b472-f44c32e1c7f2 req-9837528a-f20a-4a89-b528-1eca66a8683b service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-1b87199c-d9a2-4f2d-b472-f44c32e1c7f2 req-9837528a-f20a-4a89-b528-1eca66a8683b service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-unplugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:23 user nova-compute[74540]: WARNING nova.compute.manager [req-1b87199c-d9a2-4f2d-b472-f44c32e1c7f2 req-9837528a-f20a-4a89-b528-1eca66a8683b service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-unplugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state active and task_state rescuing.
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-18752a48-e1cb-4300-b4d3-656c042f4942 req-eb439f24-c57c-4ad1-b289-023fef5c4f22 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Received event network-vif-unplugged-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-18752a48-e1cb-4300-b4d3-656c042f4942 req-eb439f24-c57c-4ad1-b289-023fef5c4f22 service nova] Acquiring lock "6679686b-b418-41ce-a160-97ec9df754c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-18752a48-e1cb-4300-b4d3-656c042f4942 req-eb439f24-c57c-4ad1-b289-023fef5c4f22 service nova] Lock "6679686b-b418-41ce-a160-97ec9df754c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-18752a48-e1cb-4300-b4d3-656c042f4942 req-eb439f24-c57c-4ad1-b289-023fef5c4f22 service nova] Lock "6679686b-b418-41ce-a160-97ec9df754c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-18752a48-e1cb-4300-b4d3-656c042f4942 req-eb439f24-c57c-4ad1-b289-023fef5c4f22 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] No waiting events found dispatching network-vif-unplugged-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-18752a48-e1cb-4300-b4d3-656c042f4942 req-eb439f24-c57c-4ad1-b289-023fef5c4f22 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Received event network-vif-unplugged-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-18752a48-e1cb-4300-b4d3-656c042f4942 req-eb439f24-c57c-4ad1-b289-023fef5c4f22 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Received event network-vif-plugged-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-18752a48-e1cb-4300-b4d3-656c042f4942 req-eb439f24-c57c-4ad1-b289-023fef5c4f22 service nova] Acquiring lock "6679686b-b418-41ce-a160-97ec9df754c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-18752a48-e1cb-4300-b4d3-656c042f4942 req-eb439f24-c57c-4ad1-b289-023fef5c4f22 service nova] Lock "6679686b-b418-41ce-a160-97ec9df754c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-18752a48-e1cb-4300-b4d3-656c042f4942 req-eb439f24-c57c-4ad1-b289-023fef5c4f22 service nova] Lock "6679686b-b418-41ce-a160-97ec9df754c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-18752a48-e1cb-4300-b4d3-656c042f4942 req-eb439f24-c57c-4ad1-b289-023fef5c4f22 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] No waiting events found dispatching network-vif-plugged-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:24 user nova-compute[74540]: WARNING nova.compute.manager [req-18752a48-e1cb-4300-b4d3-656c042f4942 req-eb439f24-c57c-4ad1-b289-023fef5c4f22 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Received unexpected event network-vif-plugged-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 for instance with vm_state active and task_state deleting.
Nov 07 04:01:24 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Instance destroyed successfully.
Nov 07 04:01:24 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Attempting rescue
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74540) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Instance directory exists: not creating {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 04:01:24 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Creating image(s)
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "/opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "/opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "/opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'trusted_certs' on Instance uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:24 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Took 1.07 seconds to deallocate network for instance.
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-917943a9-e8f5-406e-9568-040191436cae req-6608554f-f6b3-4540-8f58-cc42ae83e941 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Received event network-vif-deleted-2531d2c8-bb10-4e14-a52b-7d7a5ec43153 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:24 user nova-compute[74540]: INFO nova.compute.manager [req-917943a9-e8f5-406e-9568-040191436cae req-6608554f-f6b3-4540-8f58-cc42ae83e941 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Neutron deleted interface 2531d2c8-bb10-4e14-a52b-7d7a5ec43153; detaching it from the instance and deleting it from the info cache
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.network.neutron [req-917943a9-e8f5-406e-9568-040191436cae req-6608554f-f6b3-4540-8f58-cc42ae83e941 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.224s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.rescue {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-917943a9-e8f5-406e-9568-040191436cae req-6608554f-f6b3-4540-8f58-cc42ae83e941 service nova] [instance: 6679686b-b418-41ce-a160-97ec9df754c7] Detach interface failed, port_id=2531d2c8-bb10-4e14-a52b-7d7a5ec43153, reason: Instance 6679686b-b418-41ce-a160-97ec9df754c7 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.rescue" returned: 0 in 0.051s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'migration_context' on Instance uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.objects.base [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<22ebfad2-30ec-4f1a-8575-d655d36c6f91> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Start _get_guest_xml network_info=[{"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "vif_mac": "fa:16:3e:75:7b:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'resources' on Instance uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.objects.base [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<22ebfad2-30ec-4f1a-8575-d655d36c6f91> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'numa_topology' on Instance uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.objects.base [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<22ebfad2-30ec-4f1a-8575-d655d36c6f91> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:01:24 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:01:24 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'vcpu_model' on Instance uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.objects.base [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<22ebfad2-30ec-4f1a-8575-d655d36c6f91> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-345609166',display_name='tempest-ServerRescueNegativeTestJSON-server-345609166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-345609166',id=1,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:56:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60a9f3df6bba4675b2332ac4ded5373e',ramdisk_id='',reservation_id='r-rw6qcnv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1326022799',owner_user_name='tempest-ServerRescueNegativeTestJSON-1326022799-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T03:56:50Z,user_data=None,user_id='c3b660fa816a404196af3027d19aea51',uuid=22ebfad2-30ec-4f1a-8575-d655d36c6f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "vif_mac": "fa:16:3e:75:7b:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converting VIF {"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "vif_mac": "fa:16:3e:75:7b:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:7b:81,bridge_name='br-int',has_traffic_filtering=True,id=22b86445-e99f-4e4c-a265-bd37533ae9cf,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b86445-e9') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'pci_devices' on Instance uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.objects.base [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<22ebfad2-30ec-4f1a-8575-d655d36c6f91> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:01:24 user nova-compute[74540]:   <uuid>22ebfad2-30ec-4f1a-8575-d655d36c6f91</uuid>
Nov 07 04:01:24 user nova-compute[74540]:   <name>instance-00000001</name>
Nov 07 04:01:24 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:01:24 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:01:24 user nova-compute[74540]:   <metadata>
Nov 07 04:01:24 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:01:24 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:01:24 user nova-compute[74540]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-345609166</nova:name>
Nov 07 04:01:24 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:01:24</nova:creationTime>
Nov 07 04:01:24 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:01:24 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:01:24 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:01:24 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:01:24 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:01:24 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:01:24 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:01:24 user nova-compute[74540]:       <nova:owner>
Nov 07 04:01:24 user nova-compute[74540]:         <nova:user uuid="c3b660fa816a404196af3027d19aea51">tempest-ServerRescueNegativeTestJSON-1326022799-project-member</nova:user>
Nov 07 04:01:24 user nova-compute[74540]:         <nova:project uuid="60a9f3df6bba4675b2332ac4ded5373e">tempest-ServerRescueNegativeTestJSON-1326022799</nova:project>
Nov 07 04:01:24 user nova-compute[74540]:       </nova:owner>
Nov 07 04:01:24 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:01:24 user nova-compute[74540]:       <nova:ports>
Nov 07 04:01:24 user nova-compute[74540]:         <nova:port uuid="22b86445-e99f-4e4c-a265-bd37533ae9cf">
Nov 07 04:01:24 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 04:01:24 user nova-compute[74540]:         </nova:port>
Nov 07 04:01:24 user nova-compute[74540]:       </nova:ports>
Nov 07 04:01:24 user nova-compute[74540]:     </nova:instance>
Nov 07 04:01:24 user nova-compute[74540]:   </metadata>
Nov 07 04:01:24 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:01:24 user nova-compute[74540]:     <system>
Nov 07 04:01:24 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:01:24 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:01:24 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:01:24 user nova-compute[74540]:       <entry name="serial">22ebfad2-30ec-4f1a-8575-d655d36c6f91</entry>
Nov 07 04:01:24 user nova-compute[74540]:       <entry name="uuid">22ebfad2-30ec-4f1a-8575-d655d36c6f91</entry>
Nov 07 04:01:24 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:01:24 user nova-compute[74540]:     </system>
Nov 07 04:01:24 user nova-compute[74540]:   </sysinfo>
Nov 07 04:01:24 user nova-compute[74540]:   <os>
Nov 07 04:01:24 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:01:24 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:01:24 user nova-compute[74540]:   </os>
Nov 07 04:01:24 user nova-compute[74540]:   <features>
Nov 07 04:01:24 user nova-compute[74540]:     <acpi/>
Nov 07 04:01:24 user nova-compute[74540]:     <apic/>
Nov 07 04:01:24 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:01:24 user nova-compute[74540]:   </features>
Nov 07 04:01:24 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:01:24 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:01:24 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:01:24 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:01:24 user nova-compute[74540]:   </clock>
Nov 07 04:01:24 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:01:24 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:01:24 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:01:24 user nova-compute[74540]:   </cpu>
Nov 07 04:01:24 user nova-compute[74540]:   <devices>
Nov 07 04:01:24 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:01:24 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:01:24 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.rescue"/>
Nov 07 04:01:24 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:01:24 user nova-compute[74540]:     </disk>
Nov 07 04:01:24 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:01:24 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:01:24 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk"/>
Nov 07 04:01:24 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 04:01:24 user nova-compute[74540]:     </disk>
Nov 07 04:01:24 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:01:24 user nova-compute[74540]:       <mac address="fa:16:3e:75:7b:81"/>
Nov 07 04:01:24 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:01:24 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:01:24 user nova-compute[74540]:       <target dev="tap22b86445-e9"/>
Nov 07 04:01:24 user nova-compute[74540]:     </interface>
Nov 07 04:01:24 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:01:24 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/console.log" append="off"/>
Nov 07 04:01:24 user nova-compute[74540]:     </serial>
Nov 07 04:01:24 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:01:24 user nova-compute[74540]:     <video>
Nov 07 04:01:24 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:01:24 user nova-compute[74540]:     </video>
Nov 07 04:01:24 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:01:24 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:01:24 user nova-compute[74540]:     </rng>
Nov 07 04:01:24 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:01:24 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:01:24 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:01:24 user nova-compute[74540]:     </memballoon>
Nov 07 04:01:24 user nova-compute[74540]:   </devices>
Nov 07 04:01:24 user nova-compute[74540]: </domain>
Nov 07 04:01:24 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:01:24 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Instance destroyed successfully.
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:01:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No VIF found with MAC fa:16:3e:75:7b:81, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:01:25 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:01:25 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:01:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:25 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Deleted allocations for instance 6679686b-b418-41ce-a160-97ec9df754c7
Nov 07 04:01:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0b4ed5f5-c50a-4db6-b9b0-39de73f8df0f tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "6679686b-b418-41ce-a160-97ec9df754c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.579s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-d0778408-f5f0-456e-a611-b3037abf8a1d req-560cbe69-aaa6-4794-bbbf-ab90bf87514f service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d0778408-f5f0-456e-a611-b3037abf8a1d req-560cbe69-aaa6-4794-bbbf-ab90bf87514f service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d0778408-f5f0-456e-a611-b3037abf8a1d req-560cbe69-aaa6-4794-bbbf-ab90bf87514f service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d0778408-f5f0-456e-a611-b3037abf8a1d req-560cbe69-aaa6-4794-bbbf-ab90bf87514f service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-d0778408-f5f0-456e-a611-b3037abf8a1d req-560cbe69-aaa6-4794-bbbf-ab90bf87514f service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:26 user nova-compute[74540]: WARNING nova.compute.manager [req-d0778408-f5f0-456e-a611-b3037abf8a1d req-560cbe69-aaa6-4794-bbbf-ab90bf87514f service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state active and task_state rescuing.
Nov 07 04:01:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:01:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-7dbd0ebe-6857-4a8d-95bd-4ae845869e8b req-d65b72d2-12a7-4db8-bb2c-1e7ce6180ad3 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7dbd0ebe-6857-4a8d-95bd-4ae845869e8b req-d65b72d2-12a7-4db8-bb2c-1e7ce6180ad3 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7dbd0ebe-6857-4a8d-95bd-4ae845869e8b req-d65b72d2-12a7-4db8-bb2c-1e7ce6180ad3 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7dbd0ebe-6857-4a8d-95bd-4ae845869e8b req-d65b72d2-12a7-4db8-bb2c-1e7ce6180ad3 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-7dbd0ebe-6857-4a8d-95bd-4ae845869e8b req-d65b72d2-12a7-4db8-bb2c-1e7ce6180ad3 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:28 user nova-compute[74540]: WARNING nova.compute.manager [req-7dbd0ebe-6857-4a8d-95bd-4ae845869e8b req-d65b72d2-12a7-4db8-bb2c-1e7ce6180ad3 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state active and task_state rescuing.
Nov 07 04:01:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-7dbd0ebe-6857-4a8d-95bd-4ae845869e8b req-d65b72d2-12a7-4db8-bb2c-1e7ce6180ad3 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7dbd0ebe-6857-4a8d-95bd-4ae845869e8b req-d65b72d2-12a7-4db8-bb2c-1e7ce6180ad3 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7dbd0ebe-6857-4a8d-95bd-4ae845869e8b req-d65b72d2-12a7-4db8-bb2c-1e7ce6180ad3 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7dbd0ebe-6857-4a8d-95bd-4ae845869e8b req-d65b72d2-12a7-4db8-bb2c-1e7ce6180ad3 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-7dbd0ebe-6857-4a8d-95bd-4ae845869e8b req-d65b72d2-12a7-4db8-bb2c-1e7ce6180ad3 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:28 user nova-compute[74540]: WARNING nova.compute.manager [req-7dbd0ebe-6857-4a8d-95bd-4ae845869e8b req-d65b72d2-12a7-4db8-bb2c-1e7ce6180ad3 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state active and task_state rescuing.
Nov 07 04:01:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:28 user nova-compute[74540]: DEBUG nova.compute.manager [None req-d5635b36-a307-4dcf-9d73-a5c5cd73b7f8 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:01:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:30 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:01:31 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:01:31 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:01:32 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:01:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:01:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-d6501f90-9180-4e99-a294-9ffba799c247" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:01:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-d6501f90-9180-4e99-a294-9ffba799c247" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:01:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Updating instance_info_cache with network_info: [{"id": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "address": "fa:16:3e:5c:97:16", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec97afff-df", "ovs_interfaceid": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-d6501f90-9180-4e99-a294-9ffba799c247" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:01:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:01:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:01:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdl (vdc) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:01:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7474MB free_disk=25.16857147216797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Applying migration context for instance a3cae7a7-223c-438e-8206-39e0f1683cb0 as it has an incoming, in-progress migration f4a9c60a-8456-4e01-9930-f701674cbe09. Migration status is finished {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 07 04:01:38 user nova-compute[74540]: INFO nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating resource usage from migration f4a9c60a-8456-4e01-9930-f701674cbe09
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d6501f90-9180-4e99-a294-9ffba799c247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6d43f26f-dfbb-4299-b875-f498979679d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d248eae-ef06-4be3-9178-15d54309be59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance fab159b1-8768-4266-9a2f-3983628aeb86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d6098213-4199-4660-b36a-ea1908fa9ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Migration f4a9c60a-8456-4e01-9930-f701674cbe09 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a3cae7a7-223c-438e-8206-39e0f1683cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:01:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5d248eae-ef06-4be3-9178-15d54309be59 is timed out.
Nov 07 04:01:38 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Successfully detached device vdb from instance 5d248eae-ef06-4be3-9178-15d54309be59 from the live domain config.
Nov 07 04:01:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCfRSmPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'bef07b9d-ce1e-4543-abbd-ce125a6830e1'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:01:38 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:01:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[67557073-9dfa-4d51-b7e7-02c6c14cd702]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:01:38 user nova-compute[74540]: No targets found.
Nov 07 04:01:38 user nova-compute[74540]: iSNS:
Nov 07 04:01:38 user nova-compute[74540]: No targets found.
Nov 07 04:01:38 user nova-compute[74540]: STATIC:
Nov 07 04:01:38 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:01:38 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:38 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:38 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:01:38 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:38 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:38 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:01:38 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:38 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:38 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:01:38 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:38 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:38 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:01:38 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:38 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:38 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1
Nov 07 04:01:38 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:38 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:38 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:01:38 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:38 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:38 user nova-compute[74540]: FIRMWARE:
Nov 07 04:01:38 user nova-compute[74540]: No targets found.
Nov 07 04:01:38 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:01:38 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:01:38 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:01:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[72136672-06b8-4018-a439-148af74c018e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fc6353-9625-40d3-8d52-0b944cdf2878]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:39 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:39 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:39 user nova-compute[74540]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:01:39 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:39 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:39 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:39 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:39 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:39 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:39 user nova-compute[74540]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 (non-flash)
Nov 07 04:01:39 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:39 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:39 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:39 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee143cdf30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1'): ({'sdd'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Removing single pathed devices sdd {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3af8fd-0703-4ba3-9c1f-42d0daf93267]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[966fccc5-fe31-49a1-a57f-a8b7d1801471]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Flushing IO for device /dev/sdd {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b31b71-b738-4cf1-8150-77592ac8621d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2851fb1-23b8-42be-a858-1b57dd95eb03]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a443291-34e2-42e2-adf5-9bf0b3d00717]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03e034b-6f4d-4f2e-99cb-50c0ec8c4124]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260]
Nov 07 04:01:39 user nova-compute[74540]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1, portal: 172.16.0.220,3260] successful.
Nov 07 04:01:39 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bef07b9d-ce1e-4543-abbd-ce125a6830e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3de51b1-ffb5-45e5-8ed7-5562ecf8df07]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] <== disconnect_volume: return (395ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:01:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:01:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:40 user nova-compute[74540]: DEBUG nova.objects.instance [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lazy-loading 'flavor' on Instance uuid 5d248eae-ef06-4be3-9178-15d54309be59 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:01:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-03578a54-2db8-44a3-92eb-299f9e024826 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "5d248eae-ef06-4be3-9178-15d54309be59" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.257s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-bc893833-24f2-42c3-a944-af55e3b9158c req-912c0e95-43ae-416d-bdd3-8e4c6c905c40 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-changed-43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-bc893833-24f2-42c3-a944-af55e3b9158c req-912c0e95-43ae-416d-bdd3-8e4c6c905c40 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing instance network info cache due to event network-changed-43c2db66-9652-40e8-8b69-3b9cc77cd456. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:01:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bc893833-24f2-42c3-a944-af55e3b9158c req-912c0e95-43ae-416d-bdd3-8e4c6c905c40 service nova] Acquiring lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:01:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bc893833-24f2-42c3-a944-af55e3b9158c req-912c0e95-43ae-416d-bdd3-8e4c6c905c40 service nova] Acquired lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:01:43 user nova-compute[74540]: DEBUG nova.network.neutron [req-bc893833-24f2-42c3-a944-af55e3b9158c req-912c0e95-43ae-416d-bdd3-8e4c6c905c40 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Refreshing network info cache for port 43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:01:44 user nova-compute[74540]: DEBUG nova.network.neutron [req-bc893833-24f2-42c3-a944-af55e3b9158c req-912c0e95-43ae-416d-bdd3-8e4c6c905c40 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updated VIF entry in instance network info cache for port 43c2db66-9652-40e8-8b69-3b9cc77cd456. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:01:44 user nova-compute[74540]: DEBUG nova.network.neutron [req-bc893833-24f2-42c3-a944-af55e3b9158c req-912c0e95-43ae-416d-bdd3-8e4c6c905c40 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [{"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "457812a7-f900-488c-9044-0eb5eccbe506", "address": "fa:16:3e:82:aa:43", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457812a7-f9", "ovs_interfaceid": "457812a7-f900-488c-9044-0eb5eccbe506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "address": "fa:16:3e:0e:5c:b7", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb75e6-78", "ovs_interfaceid": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bc893833-24f2-42c3-a944-af55e3b9158c req-912c0e95-43ae-416d-bdd3-8e4c6c905c40 service nova] Releasing lock "refresh_cache-d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:01:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:46 user nova-compute[74540]: INFO nova.compute.manager [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Terminating instance
Nov 07 04:01:46 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-8ea30091-c3a5-4d4e-b573-5ae6dc8acb5b req-9409a360-8fb4-4c43-a952-a827e560bb81 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-8eee84ce-8974-4c32-8f84-7e399c631085 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8ea30091-c3a5-4d4e-b573-5ae6dc8acb5b req-9409a360-8fb4-4c43-a952-a827e560bb81 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8ea30091-c3a5-4d4e-b573-5ae6dc8acb5b req-9409a360-8fb4-4c43-a952-a827e560bb81 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8ea30091-c3a5-4d4e-b573-5ae6dc8acb5b req-9409a360-8fb4-4c43-a952-a827e560bb81 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-8ea30091-c3a5-4d4e-b573-5ae6dc8acb5b req-9409a360-8fb4-4c43-a952-a827e560bb81 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-unplugged-8eee84ce-8974-4c32-8f84-7e399c631085 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-8ea30091-c3a5-4d4e-b573-5ae6dc8acb5b req-9409a360-8fb4-4c43-a952-a827e560bb81 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-8eee84ce-8974-4c32-8f84-7e399c631085 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-7bf9059e-7a5a-404e-8e86-d90485320c45 req-d695b019-591d-4ff7-93e2-fe88ff319415 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7bf9059e-7a5a-404e-8e86-d90485320c45 req-d695b019-591d-4ff7-93e2-fe88ff319415 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7bf9059e-7a5a-404e-8e86-d90485320c45 req-d695b019-591d-4ff7-93e2-fe88ff319415 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7bf9059e-7a5a-404e-8e86-d90485320c45 req-d695b019-591d-4ff7-93e2-fe88ff319415 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-7bf9059e-7a5a-404e-8e86-d90485320c45 req-d695b019-591d-4ff7-93e2-fe88ff319415 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-unplugged-43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-7bf9059e-7a5a-404e-8e86-d90485320c45 req-d695b019-591d-4ff7-93e2-fe88ff319415 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-43c2db66-9652-40e8-8b69-3b9cc77cd456 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-7d174202-20e5-464a-a373-c32beb9ca554 req-a4a12fbc-6e56-4ef2-b87f-8ab1785d0836 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-53b6e456-7f50-428b-a729-8acbb635add5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7d174202-20e5-464a-a373-c32beb9ca554 req-a4a12fbc-6e56-4ef2-b87f-8ab1785d0836 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7d174202-20e5-464a-a373-c32beb9ca554 req-a4a12fbc-6e56-4ef2-b87f-8ab1785d0836 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7d174202-20e5-464a-a373-c32beb9ca554 req-a4a12fbc-6e56-4ef2-b87f-8ab1785d0836 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-7d174202-20e5-464a-a373-c32beb9ca554 req-a4a12fbc-6e56-4ef2-b87f-8ab1785d0836 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-unplugged-53b6e456-7f50-428b-a729-8acbb635add5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-7d174202-20e5-464a-a373-c32beb9ca554 req-a4a12fbc-6e56-4ef2-b87f-8ab1785d0836 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-53b6e456-7f50-428b-a729-8acbb635add5 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:01:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Instance destroyed successfully.
Nov 07 04:01:48 user nova-compute[74540]: DEBUG nova.objects.instance [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lazy-loading 'resources' on Instance uuid d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:00:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:5a:40,bridge_name='br-int',has_traffic_filtering=True,id=43c2db66-9652-40e8-8b69-3b9cc77cd456,network=Network(bcc480dd-9844-44a4-89a8-986b8aa74a9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c2db66-96') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:5a:40,bridge_name='br-int',has_traffic_filtering=True,id=43c2db66-9652-40e8-8b69-3b9cc77cd456,network=Network(bcc480dd-9844-44a4-89a8-986b8aa74a9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c2db66-96') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43c2db66-96, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26bf12b7-cd05-4fc8-8274-b04e9a5ee1c3) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: INFO os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:5a:40,bridge_name='br-int',has_traffic_filtering=True,id=43c2db66-9652-40e8-8b69-3b9cc77cd456,network=Network(bcc480dd-9844-44a4-89a8-986b8aa74a9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43c2db66-96')
Nov 07 04:01:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:00:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:3a,bridge_name='br-int',has_traffic_filtering=True,id=8eee84ce-8974-4c32-8f84-7e399c631085,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eee84ce-89') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:3a,bridge_name='br-int',has_traffic_filtering=True,id=8eee84ce-8974-4c32-8f84-7e399c631085,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eee84ce-89') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eee84ce-89, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64cd4801-7e85-416c-b1d7-dc846a234f84) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: INFO os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2c:3a,bridge_name='br-int',has_traffic_filtering=True,id=8eee84ce-8974-4c32-8f84-7e399c631085,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8eee84ce-89')
Nov 07 04:01:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:00:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:a5:84,bridge_name='br-int',has_traffic_filtering=True,id=53b6e456-7f50-428b-a729-8acbb635add5,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53b6e456-7f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:a5:84,bridge_name='br-int',has_traffic_filtering=True,id=53b6e456-7f50-428b-a729-8acbb635add5,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53b6e456-7f') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53b6e456-7f, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abd89543-e1e4-4543-a68c-2f259942f76e) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: INFO os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:a5:84,bridge_name='br-int',has_traffic_filtering=True,id=53b6e456-7f50-428b-a729-8acbb635add5,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53b6e456-7f')
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:00:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=57eef42e-ec2b-44c5-aa5b-45e943f783e2,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57eef42e-ec') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=57eef42e-ec2b-44c5-aa5b-45e943f783e2,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57eef42e-ec') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57eef42e-ec, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63ec0260-4c7b-40aa-b8a0-98f5e6707bd1) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: INFO os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:f1:61,bridge_name='br-int',has_traffic_filtering=True,id=57eef42e-ec2b-44c5-aa5b-45e943f783e2,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57eef42e-ec')
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:00:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:1d:b1,bridge_name='br-int',has_traffic_filtering=True,id=819961d9-d8e8-4cfb-b022-4a2eb954754a,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819961d9-d8') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:1d:b1,bridge_name='br-int',has_traffic_filtering=True,id=819961d9-d8e8-4cfb-b022-4a2eb954754a,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819961d9-d8') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap819961d9-d8, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91524ae8-aab2-4cb7-9070-26f086b352cb) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: INFO os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:1d:b1,bridge_name='br-int',has_traffic_filtering=True,id=819961d9-d8e8-4cfb-b022-4a2eb954754a,network=Network(15ac5329-c39c-439b-b880-72e4f947528e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap819961d9-d8')
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:00:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "457812a7-f900-488c-9044-0eb5eccbe506", "address": "fa:16:3e:82:aa:43", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457812a7-f9", "ovs_interfaceid": "457812a7-f900-488c-9044-0eb5eccbe506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "457812a7-f900-488c-9044-0eb5eccbe506", "address": "fa:16:3e:82:aa:43", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457812a7-f9", "ovs_interfaceid": "457812a7-f900-488c-9044-0eb5eccbe506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=457812a7-f900-488c-9044-0eb5eccbe506,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457812a7-f9') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=457812a7-f900-488c-9044-0eb5eccbe506,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457812a7-f9') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap457812a7-f9, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2be3f417-e41e-44e2-af34-e80399890268) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-8eee84ce-8974-4c32-8f84-7e399c631085 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-8eee84ce-8974-4c32-8f84-7e399c631085 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:49 user nova-compute[74540]: WARNING nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-8eee84ce-8974-4c32-8f84-7e399c631085 for instance with vm_state active and task_state deleting.
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-unplugged-57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-57eef42e-ec2b-44c5-aa5b-45e943f783e2 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:49 user nova-compute[74540]: WARNING nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-57eef42e-ec2b-44c5-aa5b-45e943f783e2 for instance with vm_state active and task_state deleting.
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-unplugged-819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-819961d9-d8e8-4cfb-b022-4a2eb954754a for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:49 user nova-compute[74540]: WARNING nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-819961d9-d8e8-4cfb-b022-4a2eb954754a for instance with vm_state active and task_state deleting.
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-unplugged-33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-33bb75e6-7891-4c52-874c-855c3c1ac9c5 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:49 user nova-compute[74540]: WARNING nova.compute.manager [req-41e3d190-1e2c-417d-9981-7f886d2c19bd req-067c44a8-5166-4081-a17f-a04f58a17693 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-33bb75e6-7891-4c52-874c-855c3c1ac9c5 for instance with vm_state active and task_state deleting.
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: INFO os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:aa:43,bridge_name='br-int',has_traffic_filtering=True,id=457812a7-f900-488c-9044-0eb5eccbe506,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457812a7-f9')
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T03:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1182088429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1182088429',id=12,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkosGY1NO94/0hUMIlR3d7Zuwy5XeyFnPFf95t1ndHapF7z8d9D6bnzbHqFiML083j1jYcnhuWFkaUpzBYE6eiXDviRhnldJCSOZx/4HTBc8ADD+7BtJCnYRn2uFHhpKw==',key_name='tempest-keypair-174034716',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:00:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cfb8ff5a06d455c981ce7051e424aa1',ramdisk_id='',reservation_id='r-9o9inmru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1268906931',owner_user_name='tempest-TaggedBootDevicesTest_v242-1268906931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:00:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d27d820855314e489ea12aba2f488449',uuid=d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "address": "fa:16:3e:0e:5c:b7", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb75e6-78", "ovs_interfaceid": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converting VIF {"id": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "address": "fa:16:3e:0e:5c:b7", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb75e6-78", "ovs_interfaceid": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=33bb75e6-7891-4c52-874c-855c3c1ac9c5,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb75e6-78') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=33bb75e6-7891-4c52-874c-855c3c1ac9c5,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb75e6-78') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33bb75e6-78, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f66711d-e1be-4ac7-bf19-4a6ef802ff06) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:49 user nova-compute[74540]: INFO os_vif [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5c:b7,bridge_name='br-int',has_traffic_filtering=True,id=33bb75e6-7891-4c52-874c-855c3c1ac9c5,network=Network(1f2444eb-961f-44a5-b704-108f7c3d25d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33bb75e6-78')
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtWGvosO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:01:49 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a6b15f-a3ff-4cb5-af69-c154f2a3bee9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:01:49 user nova-compute[74540]: No targets found.
Nov 07 04:01:49 user nova-compute[74540]: iSNS:
Nov 07 04:01:49 user nova-compute[74540]: No targets found.
Nov 07 04:01:49 user nova-compute[74540]: STATIC:
Nov 07 04:01:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:01:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:01:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60
Nov 07 04:01:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:01:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:01:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:01:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:49 user nova-compute[74540]: FIRMWARE:
Nov 07 04:01:49 user nova-compute[74540]: No targets found.
Nov 07 04:01:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:01:49 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:01:49 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d013b884-3bd0-4fd7-987e-2f4c24c29b3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d482f4a0-b0b4-4fda-8357-e57bb45b965c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 (non-flash)
Nov 07 04:01:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc39d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60'): ({'sdi'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Removing single pathed devices sdi {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeba6dc-4f99-4fcd-bef5-1f0701524dea]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d569be2-2d3e-4a5d-9bd1-df16d3e79c12]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Flushing IO for device /dev/sdi {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bc7d46-df7a-4b7e-b324-4c51eceb9445]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70b3c09-0ad6-426a-80df-438e8b99dd8d]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] SCSI volumes sdi have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95e2587-e9dd-4b70-b58b-0e0407cae9ec]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3629818b-b914-4d2a-8942-1b5d490e1121]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60, portal: 172.16.0.220,3260]
Nov 07 04:01:49 user nova-compute[74540]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60, portal: 172.16.0.220,3260] successful.
Nov 07 04:01:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb37dc02-088b-464c-a566-e78213216c60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[854e8e9d-7d77-477f-ad28-8196c5e53750]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] <== disconnect_volume: return (375ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'stWLuSpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:01:49 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a0ead2-a8b3-44e9-8eba-d4a51c9bbaff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:01:49 user nova-compute[74540]: No targets found.
Nov 07 04:01:49 user nova-compute[74540]: iSNS:
Nov 07 04:01:49 user nova-compute[74540]: No targets found.
Nov 07 04:01:49 user nova-compute[74540]: STATIC:
Nov 07 04:01:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:01:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:01:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd
Nov 07 04:01:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:01:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:01:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:49 user nova-compute[74540]: FIRMWARE:
Nov 07 04:01:49 user nova-compute[74540]: No targets found.
Nov 07 04:01:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:01:49 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:01:49 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd4da6f-8edf-4985-84a2-5d312f7ba140]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-e65bdbf0-cd47-4db8-a357-924ef5bc96d0 req-84d5a900-ff10-4718-846b-fdcb296d8fec service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e65bdbf0-cd47-4db8-a357-924ef5bc96d0 req-84d5a900-ff10-4718-846b-fdcb296d8fec service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e65bdbf0-cd47-4db8-a357-924ef5bc96d0 req-84d5a900-ff10-4718-846b-fdcb296d8fec service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e65bdbf0-cd47-4db8-a357-924ef5bc96d0 req-84d5a900-ff10-4718-846b-fdcb296d8fec service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-e65bdbf0-cd47-4db8-a357-924ef5bc96d0 req-84d5a900-ff10-4718-846b-fdcb296d8fec service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:49 user nova-compute[74540]: WARNING nova.compute.manager [req-e65bdbf0-cd47-4db8-a357-924ef5bc96d0 req-84d5a900-ff10-4718-846b-fdcb296d8fec service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-43c2db66-9652-40e8-8b69-3b9cc77cd456 for instance with vm_state active and task_state deleting.
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[735c5785-7bb4-4f1e-b9c1-3c51a67e0247]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:49 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc3f6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d768e92-3852-4ab0-95e7-fbc7ea6e45f0]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-53b6e456-7f50-428b-a729-8acbb635add5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-53b6e456-7f50-428b-a729-8acbb635add5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:49 user nova-compute[74540]: WARNING nova.compute.manager [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-53b6e456-7f50-428b-a729-8acbb635add5 for instance with vm_state active and task_state deleting.
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-unplugged-457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-unplugged-457812a7-f900-488c-9044-0eb5eccbe506 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-plugged-457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] Acquiring lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] No waiting events found dispatching network-vif-plugged-457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:01:49 user nova-compute[74540]: WARNING nova.compute.manager [req-ddd25514-1db2-4d3f-b6d6-7d35a787fb48 req-4dbaec3c-3599-4d74-8141-7fc51293be59 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received unexpected event network-vif-plugged-457812a7-f900-488c-9044-0eb5eccbe506 for instance with vm_state active and task_state deleting.
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7274cd8c-c921-45aa-abb5-7f17ffa54ba6]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbee449-55aa-452d-8183-96570fc01583]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0f6e4c-a8be-468e-b376-e1922c5e7bae]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd447f6-d438-45e7-bfe4-01366c3ce551]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beeec70-94a2-4de6-8baa-43ea35771a38]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd, portal: 172.16.0.220,3260]
Nov 07 04:01:50 user nova-compute[74540]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd, portal: 172.16.0.220,3260] successful.
Nov 07 04:01:50 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6586c99b-31cc-4c88-8c66-2af7f3a6d3fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccf9501-c383-4453-b4f9-897ffa72a8f5]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] <== disconnect_volume: return (422ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVEeXgNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:01:50 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[341933c3-59bd-4b2a-97b6-58a9e3b35671]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:01:50 user nova-compute[74540]: No targets found.
Nov 07 04:01:50 user nova-compute[74540]: iSNS:
Nov 07 04:01:50 user nova-compute[74540]: No targets found.
Nov 07 04:01:50 user nova-compute[74540]: STATIC:
Nov 07 04:01:50 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4
Nov 07 04:01:50 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:50 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:50 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:01:50 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:50 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:50 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:01:50 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:50 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:50 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:01:50 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:01:50 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:01:50 user nova-compute[74540]: FIRMWARE:
Nov 07 04:01:50 user nova-compute[74540]: No targets found.
Nov 07 04:01:50 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:01:50 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:01:50 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[605624e9-fe91-423e-8dc0-df3dea7bf384]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[95578922-b94f-4ef1-bc49-c781cda4644a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:50 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:50 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:50 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:50 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 (non-flash)
Nov 07 04:01:50 user nova-compute[74540]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:01:50 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:01:50 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:01:50 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc3f6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4'): ({'sdl'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Removing single pathed devices sdl {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4432a44e-4855-4eee-ba69-459909f5cb01]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d800cc96-fd20-48ba-9243-7ae5615c2ca9]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Flushing IO for device /dev/sdl {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[735996e7-5ccf-4011-aed0-8bdfe2ad2c00]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.059s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6f29ce-47a3-4c74-b92b-894e4169a164]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] SCSI volumes sdl have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fcf5bd-07e9-41fb-9a02-d287d1dc9438]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fef793f-644e-40a7-aac0-352c4a181c32]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4, portal: 172.16.0.220,3260]
Nov 07 04:01:50 user nova-compute[74540]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4, portal: 172.16.0.220,3260] successful.
Nov 07 04:01:50 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49d04f29-37ec-4d4e-a075-b4423dbff9b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db012ef-d7a5-4d0a-bfdb-744ffee3f79e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] <== disconnect_volume: return (354ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:01:50 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Deleting instance files /opt/stack/data/nova/instances/d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d_del
Nov 07 04:01:50 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Deletion of /opt/stack/data/nova/instances/d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d_del complete
Nov 07 04:01:50 user nova-compute[74540]: INFO nova.compute.manager [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Took 4.28 seconds to destroy the instance on the hypervisor.
Nov 07 04:01:50 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:01:50 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:01:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-1e2d7cc5-e8cd-41af-a884-930e37d0c71a req-7ad7b55a-ba11-46e7-845c-241bd159501b service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-deleted-457812a7-f900-488c-9044-0eb5eccbe506 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:52 user nova-compute[74540]: INFO nova.compute.manager [req-1e2d7cc5-e8cd-41af-a884-930e37d0c71a req-7ad7b55a-ba11-46e7-845c-241bd159501b service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Neutron deleted interface 457812a7-f900-488c-9044-0eb5eccbe506; detaching it from the instance and deleting it from the info cache
Nov 07 04:01:52 user nova-compute[74540]: DEBUG nova.network.neutron [req-1e2d7cc5-e8cd-41af-a884-930e37d0c71a req-7ad7b55a-ba11-46e7-845c-241bd159501b service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [{"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "address": "fa:16:3e:0e:5c:b7", "network": {"id": "1f2444eb-961f-44a5-b704-108f7c3d25d1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1766489788", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33bb75e6-78", "ovs_interfaceid": "33bb75e6-7891-4c52-874c-855c3c1ac9c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-1e2d7cc5-e8cd-41af-a884-930e37d0c71a req-7ad7b55a-ba11-46e7-845c-241bd159501b service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Detach interface failed, port_id=457812a7-f900-488c-9044-0eb5eccbe506, reason: Instance d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:01:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-a2164d77-fb6a-4205-b145-ab7075a27dbe req-ac02ae39-2595-4dff-9380-748e4e419a3d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-deleted-33bb75e6-7891-4c52-874c-855c3c1ac9c5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:54 user nova-compute[74540]: INFO nova.compute.manager [req-a2164d77-fb6a-4205-b145-ab7075a27dbe req-ac02ae39-2595-4dff-9380-748e4e419a3d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Neutron deleted interface 33bb75e6-7891-4c52-874c-855c3c1ac9c5; detaching it from the instance and deleting it from the info cache
Nov 07 04:01:54 user nova-compute[74540]: DEBUG nova.network.neutron [req-a2164d77-fb6a-4205-b145-ab7075a27dbe req-ac02ae39-2595-4dff-9380-748e4e419a3d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [{"id": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "address": "fa:16:3e:89:5a:40", "network": {"id": "bcc480dd-9844-44a4-89a8-986b8aa74a9e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-525061320-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43c2db66-96", "ovs_interfaceid": "43c2db66-9652-40e8-8b69-3b9cc77cd456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-a2164d77-fb6a-4205-b145-ab7075a27dbe req-ac02ae39-2595-4dff-9380-748e4e419a3d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Detach interface failed, port_id=33bb75e6-7891-4c52-874c-855c3c1ac9c5, reason: Instance d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:01:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-a2164d77-fb6a-4205-b145-ab7075a27dbe req-ac02ae39-2595-4dff-9380-748e4e419a3d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-deleted-43c2db66-9652-40e8-8b69-3b9cc77cd456 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:54 user nova-compute[74540]: INFO nova.compute.manager [req-a2164d77-fb6a-4205-b145-ab7075a27dbe req-ac02ae39-2595-4dff-9380-748e4e419a3d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Neutron deleted interface 43c2db66-9652-40e8-8b69-3b9cc77cd456; detaching it from the instance and deleting it from the info cache
Nov 07 04:01:54 user nova-compute[74540]: DEBUG nova.network.neutron [req-a2164d77-fb6a-4205-b145-ab7075a27dbe req-ac02ae39-2595-4dff-9380-748e4e419a3d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [{"id": "8eee84ce-8974-4c32-8f84-7e399c631085", "address": "fa:16:3e:b9:2c:3a", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eee84ce-89", "ovs_interfaceid": "8eee84ce-8974-4c32-8f84-7e399c631085", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53b6e456-7f50-428b-a729-8acbb635add5", "address": "fa:16:3e:06:a5:84", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53b6e456-7f", "ovs_interfaceid": "53b6e456-7f50-428b-a729-8acbb635add5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "address": "fa:16:3e:de:f1:61", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57eef42e-ec", "ovs_interfaceid": "57eef42e-ec2b-44c5-aa5b-45e943f783e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "address": "fa:16:3e:cb:1d:b1", "network": {"id": "15ac5329-c39c-439b-b880-72e4f947528e", "bridge": "br-int", "label": "tempest-device-tagging-net1-641342753", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6cfb8ff5a06d455c981ce7051e424aa1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap819961d9-d8", "ovs_interfaceid": "819961d9-d8e8-4cfb-b022-4a2eb954754a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-a2164d77-fb6a-4205-b145-ab7075a27dbe req-ac02ae39-2595-4dff-9380-748e4e419a3d service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Detach interface failed, port_id=43c2db66-9652-40e8-8b69-3b9cc77cd456, reason: Instance d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:01:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:55 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:01:55 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Took 4.90 seconds to deallocate network for instance.
Nov 07 04:01:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9920d614-e6ce-4267-9ea6-a14ce573541a req-3df8dbae-e995-4bb5-aff7-1cf08682d353 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-deleted-57eef42e-ec2b-44c5-aa5b-45e943f783e2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-9920d614-e6ce-4267-9ea6-a14ce573541a req-3df8dbae-e995-4bb5-aff7-1cf08682d353 service nova] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Received event network-vif-deleted-819961d9-d8e8-4cfb-b022-4a2eb954754a {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:01:58 user nova-compute[74540]: INFO nova.compute.manager [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] [instance: d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d] Took 2.79 seconds to detach 3 volumes for instance.
Nov 07 04:01:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:01:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:01:58 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:01:58 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:01:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:58 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Deleted allocations for instance d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d
Nov 07 04:01:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c0f2e639-2766-473f-bb83-bd1ff831d703 tempest-TaggedBootDevicesTest_v242-1268906931 tempest-TaggedBootDevicesTest_v242-1268906931-project-member] Lock "d1e2a6f3-bce0-4989-b0fb-d2d0dbf8ed1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.609s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:01:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:01:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "5d248eae-ef06-4be3-9178-15d54309be59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "5d248eae-ef06-4be3-9178-15d54309be59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "5d248eae-ef06-4be3-9178-15d54309be59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "5d248eae-ef06-4be3-9178-15d54309be59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "5d248eae-ef06-4be3-9178-15d54309be59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:08 user nova-compute[74540]: INFO nova.compute.manager [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Terminating instance
Nov 07 04:02:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:02:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-7c8704f4-5a43-4abb-a294-a76668362a26 req-72caca81-f1dc-42f2-80e5-5443a77ad928 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Received event network-vif-unplugged-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7c8704f4-5a43-4abb-a294-a76668362a26 req-72caca81-f1dc-42f2-80e5-5443a77ad928 service nova] Acquiring lock "5d248eae-ef06-4be3-9178-15d54309be59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7c8704f4-5a43-4abb-a294-a76668362a26 req-72caca81-f1dc-42f2-80e5-5443a77ad928 service nova] Lock "5d248eae-ef06-4be3-9178-15d54309be59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7c8704f4-5a43-4abb-a294-a76668362a26 req-72caca81-f1dc-42f2-80e5-5443a77ad928 service nova] Lock "5d248eae-ef06-4be3-9178-15d54309be59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-7c8704f4-5a43-4abb-a294-a76668362a26 req-72caca81-f1dc-42f2-80e5-5443a77ad928 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] No waiting events found dispatching network-vif-unplugged-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-7c8704f4-5a43-4abb-a294-a76668362a26 req-72caca81-f1dc-42f2-80e5-5443a77ad928 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Received event network-vif-unplugged-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:09 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Instance destroyed successfully.
Nov 07 04:02:09 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lazy-loading 'resources' on Instance uuid 5d248eae-ef06-4be3-9178-15d54309be59 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1064235711',display_name='tempest-TestVolumeSwap-server-1064235711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1064235711',id=8,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8D1FR+XkoXDractWtnx2wh5nZ+gr4oimSrZ21X8Rsh9bskbNg/E+ofmIpXUY00nH4Z01viztRyneF2f4RL/W5gs3ieppnKouO7TJNtH0kORN2WBrE/jT8CRoms8C+XMQ==',key_name='tempest-keypair-160391377',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:57:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='740df87a8830417797c8126d81b36377',ramdisk_id='',reservation_id='r-l904x80m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1451835974',owner_user_name='tempest-TestVolumeSwap-1451835974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:57:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c98fea902baa441d995919633f4dff8d',uuid=5d248eae-ef06-4be3-9178-15d54309be59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "address": "fa:16:3e:d8:ff:dc", "network": {"id": "c05abc26-7a24-4c10-8a8a-dc373474d503", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1825825046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740df87a8830417797c8126d81b36377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbbc3b5-40", "ovs_interfaceid": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Converting VIF {"id": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "address": "fa:16:3e:d8:ff:dc", "network": {"id": "c05abc26-7a24-4c10-8a8a-dc373474d503", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1825825046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "740df87a8830417797c8126d81b36377", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbbc3b5-40", "ovs_interfaceid": "4cbbc3b5-403c-4f1b-84d5-0b520e4eb835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:ff:dc,bridge_name='br-int',has_traffic_filtering=True,id=4cbbc3b5-403c-4f1b-84d5-0b520e4eb835,network=Network(c05abc26-7a24-4c10-8a8a-dc373474d503),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbbc3b5-40') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG os_vif [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:ff:dc,bridge_name='br-int',has_traffic_filtering=True,id=4cbbc3b5-403c-4f1b-84d5-0b520e4eb835,network=Network(c05abc26-7a24-4c10-8a8a-dc373474d503),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbbc3b5-40') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cbbc3b5-40, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f737675-aa15-429f-9817-d0c5390e907f) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:09 user nova-compute[74540]: INFO os_vif [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:ff:dc,bridge_name='br-int',has_traffic_filtering=True,id=4cbbc3b5-403c-4f1b-84d5-0b520e4eb835,network=Network(c05abc26-7a24-4c10-8a8a-dc373474d503),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbbc3b5-40')
Nov 07 04:02:09 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Deleting instance files /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59_del
Nov 07 04:02:09 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Deletion of /opt/stack/data/nova/instances/5d248eae-ef06-4be3-9178-15d54309be59_del complete
Nov 07 04:02:09 user nova-compute[74540]: INFO nova.compute.manager [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 07 04:02:09 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:02:09 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:02:10 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:02:10 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Took 0.92 seconds to deallocate network for instance.
Nov 07 04:02:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:11 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:02:11 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:02:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:11 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Deleted allocations for instance 5d248eae-ef06-4be3-9178-15d54309be59
Nov 07 04:02:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-dbec2d14-2fa8-483a-b717-b5b97b7b9d91 req-ec3ce162-c675-426d-91ba-e516c5e07f19 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Received event network-vif-plugged-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dbec2d14-2fa8-483a-b717-b5b97b7b9d91 req-ec3ce162-c675-426d-91ba-e516c5e07f19 service nova] Acquiring lock "5d248eae-ef06-4be3-9178-15d54309be59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dbec2d14-2fa8-483a-b717-b5b97b7b9d91 req-ec3ce162-c675-426d-91ba-e516c5e07f19 service nova] Lock "5d248eae-ef06-4be3-9178-15d54309be59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dbec2d14-2fa8-483a-b717-b5b97b7b9d91 req-ec3ce162-c675-426d-91ba-e516c5e07f19 service nova] Lock "5d248eae-ef06-4be3-9178-15d54309be59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-dbec2d14-2fa8-483a-b717-b5b97b7b9d91 req-ec3ce162-c675-426d-91ba-e516c5e07f19 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] No waiting events found dispatching network-vif-plugged-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:02:11 user nova-compute[74540]: WARNING nova.compute.manager [req-dbec2d14-2fa8-483a-b717-b5b97b7b9d91 req-ec3ce162-c675-426d-91ba-e516c5e07f19 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Received unexpected event network-vif-plugged-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 for instance with vm_state deleted and task_state None.
Nov 07 04:02:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-dbec2d14-2fa8-483a-b717-b5b97b7b9d91 req-ec3ce162-c675-426d-91ba-e516c5e07f19 service nova] [instance: 5d248eae-ef06-4be3-9178-15d54309be59] Received event network-vif-deleted-4cbbc3b5-403c-4f1b-84d5-0b520e4eb835 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f79eea2c-5fce-4bb5-bf17-a9b284cddc84 tempest-TestVolumeSwap-1451835974 tempest-TestVolumeSwap-1451835974-project-member] Lock "5d248eae-ef06-4be3-9178-15d54309be59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.400s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "d6501f90-9180-4e99-a294-9ffba799c247" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "d6501f90-9180-4e99-a294-9ffba799c247" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:14 user nova-compute[74540]: INFO nova.compute.manager [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Detaching volume 3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:02:14 user nova-compute[74540]: INFO nova.virt.block_device [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Attempting to driver detach volume 3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a from mountpoint /dev/vdb
Nov 07 04:02:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Attempting to detach device vdb from instance d6501f90-9180-4e99-a294-9ffba799c247 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:02:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:02:14 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:02:14 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:02:14 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:02:14 user nova-compute[74540]:   <serial>3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a</serial>
Nov 07 04:02:14 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:02:14 user nova-compute[74540]: </disk>
Nov 07 04:02:14 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:02:14 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully detached device vdb from instance d6501f90-9180-4e99-a294-9ffba799c247 from the persistent domain config.
Nov 07 04:02:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6501f90-9180-4e99-a294-9ffba799c247 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:02:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:02:14 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:02:14 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:02:14 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:02:14 user nova-compute[74540]:   <serial>3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a</serial>
Nov 07 04:02:14 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:02:14 user nova-compute[74540]: </disk>
Nov 07 04:02:14 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:02:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6501f90-9180-4e99-a294-9ffba799c247 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:02:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "9c425dfc-962a-4d21-ba9b-110fed764c51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:02:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:02:20 user nova-compute[74540]: INFO nova.compute.claims [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Claim successful on node user
Nov 07 04:02:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:20 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:02:20 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:02:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:02:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:02:20 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:02:20 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:02:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG nova.policy [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd0ca1c305c04866b3323a98c6796ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e4bbbf680d48fe8534c9ebe909fd50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:02:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Creating image(s)
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "/opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "/opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.202s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.220s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk 1073741824" returned: 0 in 0.062s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Successfully created port: ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Cannot resize image /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Ensure instance console log exists: /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Successfully updated port: ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:02:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:02:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquired lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:02:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-c8069058-84c5-4178-987e-66377e7c73d1 req-bc905a14-c0bc-439c-9ae0-da61f350be43 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Received event network-changed-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-c8069058-84c5-4178-987e-66377e7c73d1 req-bc905a14-c0bc-439c-9ae0-da61f350be43 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Refreshing instance network info cache due to event network-changed-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c8069058-84c5-4178-987e-66377e7c73d1 req-bc905a14-c0bc-439c-9ae0-da61f350be43 service nova] Acquiring lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updating instance_info_cache with network_info: [{"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Releasing lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Instance network_info: |[{"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c8069058-84c5-4178-987e-66377e7c73d1 req-bc905a14-c0bc-439c-9ae0-da61f350be43 service nova] Acquired lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-c8069058-84c5-4178-987e-66377e7c73d1 req-bc905a14-c0bc-439c-9ae0-da61f350be43 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Refreshing network info cache for port ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Start _get_guest_xml network_info=[{"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:02:23 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:02:23 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:02:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1677579046',display_name='tempest-ServerActionsTestOtherA-server-1677579046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1677579046',id=15,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwNZBrKGScuWsQUPfoY0b3AbxyGKSkLExG0cpMUZnRvSTxBRcsFtIZ1RT1pR1+eCQdUJD5DJCUo9GsJbQ2Fmr9SGNPRCHO5qhdeLD9soxcgYrMJdlf2ABhS3l6lT6tLnQ==',key_name='tempest-keypair-987204751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-vdow37ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=9c425dfc-962a-4d21-ba9b-110fed764c51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:76:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9c9da0-8f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c425dfc-962a-4d21-ba9b-110fed764c51 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:02:23 user nova-compute[74540]:   <uuid>9c425dfc-962a-4d21-ba9b-110fed764c51</uuid>
Nov 07 04:02:23 user nova-compute[74540]:   <name>instance-0000000f</name>
Nov 07 04:02:23 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:02:23 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:02:23 user nova-compute[74540]:   <metadata>
Nov 07 04:02:23 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:02:23 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:02:23 user nova-compute[74540]:       <nova:name>tempest-ServerActionsTestOtherA-server-1677579046</nova:name>
Nov 07 04:02:23 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:02:23</nova:creationTime>
Nov 07 04:02:23 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:02:23 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:02:23 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:02:23 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:02:23 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:02:23 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:02:23 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:02:23 user nova-compute[74540]:       <nova:owner>
Nov 07 04:02:23 user nova-compute[74540]:         <nova:user uuid="bd0ca1c305c04866b3323a98c6796ded">tempest-ServerActionsTestOtherA-28801548-project-member</nova:user>
Nov 07 04:02:23 user nova-compute[74540]:         <nova:project uuid="04e4bbbf680d48fe8534c9ebe909fd50">tempest-ServerActionsTestOtherA-28801548</nova:project>
Nov 07 04:02:23 user nova-compute[74540]:       </nova:owner>
Nov 07 04:02:23 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:02:23 user nova-compute[74540]:       <nova:ports>
Nov 07 04:02:23 user nova-compute[74540]:         <nova:port uuid="ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e">
Nov 07 04:02:23 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 04:02:23 user nova-compute[74540]:         </nova:port>
Nov 07 04:02:23 user nova-compute[74540]:       </nova:ports>
Nov 07 04:02:23 user nova-compute[74540]:     </nova:instance>
Nov 07 04:02:23 user nova-compute[74540]:   </metadata>
Nov 07 04:02:23 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:02:23 user nova-compute[74540]:     <system>
Nov 07 04:02:23 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:02:23 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:02:23 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:02:23 user nova-compute[74540]:       <entry name="serial">9c425dfc-962a-4d21-ba9b-110fed764c51</entry>
Nov 07 04:02:23 user nova-compute[74540]:       <entry name="uuid">9c425dfc-962a-4d21-ba9b-110fed764c51</entry>
Nov 07 04:02:23 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:02:23 user nova-compute[74540]:     </system>
Nov 07 04:02:23 user nova-compute[74540]:   </sysinfo>
Nov 07 04:02:23 user nova-compute[74540]:   <os>
Nov 07 04:02:23 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:02:23 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:02:23 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:02:23 user nova-compute[74540]:   </os>
Nov 07 04:02:23 user nova-compute[74540]:   <features>
Nov 07 04:02:23 user nova-compute[74540]:     <acpi/>
Nov 07 04:02:23 user nova-compute[74540]:     <apic/>
Nov 07 04:02:23 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:02:23 user nova-compute[74540]:   </features>
Nov 07 04:02:23 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:02:23 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:02:23 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:02:23 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:02:23 user nova-compute[74540]:   </clock>
Nov 07 04:02:23 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:02:23 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:02:23 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:02:23 user nova-compute[74540]:   </cpu>
Nov 07 04:02:23 user nova-compute[74540]:   <devices>
Nov 07 04:02:23 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:02:23 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:02:23 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk"/>
Nov 07 04:02:23 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:02:23 user nova-compute[74540]:     </disk>
Nov 07 04:02:23 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:02:23 user nova-compute[74540]:       <mac address="fa:16:3e:1b:76:dd"/>
Nov 07 04:02:23 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:02:23 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:02:23 user nova-compute[74540]:       <target dev="tapba9c9da0-8f"/>
Nov 07 04:02:23 user nova-compute[74540]:     </interface>
Nov 07 04:02:23 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:02:23 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/console.log" append="off"/>
Nov 07 04:02:23 user nova-compute[74540]:     </serial>
Nov 07 04:02:23 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:02:23 user nova-compute[74540]:     <video>
Nov 07 04:02:23 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:02:23 user nova-compute[74540]:     </video>
Nov 07 04:02:23 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:02:23 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:02:23 user nova-compute[74540]:     </rng>
Nov 07 04:02:23 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:02:23 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:02:23 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:02:23 user nova-compute[74540]:     </memballoon>
Nov 07 04:02:23 user nova-compute[74540]:   </devices>
Nov 07 04:02:23 user nova-compute[74540]: </domain>
Nov 07 04:02:23 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:02:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1677579046',display_name='tempest-ServerActionsTestOtherA-server-1677579046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1677579046',id=15,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwNZBrKGScuWsQUPfoY0b3AbxyGKSkLExG0cpMUZnRvSTxBRcsFtIZ1RT1pR1+eCQdUJD5DJCUo9GsJbQ2Fmr9SGNPRCHO5qhdeLD9soxcgYrMJdlf2ABhS3l6lT6tLnQ==',key_name='tempest-keypair-987204751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-vdow37ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=9c425dfc-962a-4d21-ba9b-110fed764c51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:76:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9c9da0-8f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG os_vif [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:76:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9c9da0-8f') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d7a62cd-3901-5aa6-a048-9018651bad41', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba9c9da0-8f, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba9c9da0-8f, col_values=(('qos', UUID('10cf635c-ff0e-47d4-bd55-6245b9e42237')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba9c9da0-8f, col_values=(('external_ids', {'iface-id': 'ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:76:dd', 'vm-uuid': '9c425dfc-962a-4d21-ba9b-110fed764c51'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:23 user nova-compute[74540]: INFO os_vif [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:76:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9c9da0-8f')
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No VIF found with MAC fa:16:3e:1b:76:dd, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-c8069058-84c5-4178-987e-66377e7c73d1 req-bc905a14-c0bc-439c-9ae0-da61f350be43 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updated VIF entry in instance network info cache for port ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-c8069058-84c5-4178-987e-66377e7c73d1 req-bc905a14-c0bc-439c-9ae0-da61f350be43 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updating instance_info_cache with network_info: [{"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:02:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c8069058-84c5-4178-987e-66377e7c73d1 req-bc905a14-c0bc-439c-9ae0-da61f350be43 service nova] Releasing lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:02:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 04:02:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] There are 0 instances to clean {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 04:02:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-11210308-6106-4d6c-a95f-4fe1f7b3e9e4 req-26c513ae-7503-4d15-b411-a71386cd9974 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Received event network-vif-plugged-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-11210308-6106-4d6c-a95f-4fe1f7b3e9e4 req-26c513ae-7503-4d15-b411-a71386cd9974 service nova] Acquiring lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-11210308-6106-4d6c-a95f-4fe1f7b3e9e4 req-26c513ae-7503-4d15-b411-a71386cd9974 service nova] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-11210308-6106-4d6c-a95f-4fe1f7b3e9e4 req-26c513ae-7503-4d15-b411-a71386cd9974 service nova] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-11210308-6106-4d6c-a95f-4fe1f7b3e9e4 req-26c513ae-7503-4d15-b411-a71386cd9974 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] No waiting events found dispatching network-vif-plugged-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:02:25 user nova-compute[74540]: WARNING nova.compute.manager [req-11210308-6106-4d6c-a95f-4fe1f7b3e9e4 req-26c513ae-7503-4d15-b411-a71386cd9974 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Received unexpected event network-vif-plugged-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e for instance with vm_state building and task_state spawning.
Nov 07 04:02:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:25 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:26 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:26 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74540) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:02:27 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Instance spawned successfully.
Nov 07 04:02:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-554163b5-50e3-4441-bc8a-7d4c5ceeab0c req-e2bda3e3-3691-4a7a-9977-c8027630fa7f service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Received event network-vif-plugged-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-554163b5-50e3-4441-bc8a-7d4c5ceeab0c req-e2bda3e3-3691-4a7a-9977-c8027630fa7f service nova] Acquiring lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-554163b5-50e3-4441-bc8a-7d4c5ceeab0c req-e2bda3e3-3691-4a7a-9977-c8027630fa7f service nova] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-554163b5-50e3-4441-bc8a-7d4c5ceeab0c req-e2bda3e3-3691-4a7a-9977-c8027630fa7f service nova] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-554163b5-50e3-4441-bc8a-7d4c5ceeab0c req-e2bda3e3-3691-4a7a-9977-c8027630fa7f service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] No waiting events found dispatching network-vif-plugged-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:02:27 user nova-compute[74540]: WARNING nova.compute.manager [req-554163b5-50e3-4441-bc8a-7d4c5ceeab0c req-e2bda3e3-3691-4a7a-9977-c8027630fa7f service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Received unexpected event network-vif-plugged-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e for instance with vm_state building and task_state spawning.
Nov 07 04:02:27 user nova-compute[74540]: INFO nova.compute.manager [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 07 04:02:27 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:02:27 user nova-compute[74540]: INFO nova.compute.manager [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Took 7.19 seconds to build instance.
Nov 07 04:02:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7827e1b1-32b3-4bcb-941f-e43689883477 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.304s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:29 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:32 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:32 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:32 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:02:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d6501f90-9180-4e99-a294-9ffba799c247 is timed out.
Nov 07 04:02:35 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully detached device vdb from instance d6501f90-9180-4e99-a294-9ffba799c247 from the live domain config.
Nov 07 04:02:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nEapSbch', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:02:35 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8070fd14-326a-45db-87b6-912a7fe8e745]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:02:35 user nova-compute[74540]: No targets found.
Nov 07 04:02:35 user nova-compute[74540]: iSNS:
Nov 07 04:02:35 user nova-compute[74540]: No targets found.
Nov 07 04:02:35 user nova-compute[74540]: STATIC:
Nov 07 04:02:35 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:02:35 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:02:35 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:02:35 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a
Nov 07 04:02:35 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:02:35 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:02:35 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:02:35 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:02:35 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:02:35 user nova-compute[74540]: FIRMWARE:
Nov 07 04:02:35 user nova-compute[74540]: No targets found.
Nov 07 04:02:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:02:35 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:02:35 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a77e9c-e46b-4473-985a-c11fa8e98842]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb7c166-ed7a-4bdb-ac19-b7a452f98071]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:02:35 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:02:35 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:02:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:02:35 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:02:35 user nova-compute[74540]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a (non-flash)
Nov 07 04:02:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc39c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[631a896f-cb6b-4ee9-af7b-c27af0f08146]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7236d8e2-9786-4f19-9c67-010e65e08d8c]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[04efd375-6c4e-43ec-a91e-df819bba350d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da49169-b488-4f86-81ca-7da322e2c7ca]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0034ea8-a629-435e-b11d-3f5f74baae79]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08cfb90-0590-4a2b-93f5-594a69e6b4f2]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a, portal: 172.16.0.220,3260]
Nov 07 04:02:35 user nova-compute[74540]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a, portal: 172.16.0.220,3260] successful.
Nov 07 04:02:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cf4ac1a-54b8-46e8-9410-78a0d2cbf27a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee342763-5e99-42fe-a995-20ace1a7a80c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] <== disconnect_volume: return (404ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:02:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:02:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7681MB free_disk=25.17296600341797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Applying migration context for instance a3cae7a7-223c-438e-8206-39e0f1683cb0 as it has an incoming, in-progress migration f4a9c60a-8456-4e01-9930-f701674cbe09. Migration status is finished {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 07 04:02:38 user nova-compute[74540]: INFO nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating resource usage from migration f4a9c60a-8456-4e01-9930-f701674cbe09
Nov 07 04:02:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d6501f90-9180-4e99-a294-9ffba799c247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6d43f26f-dfbb-4299-b875-f498979679d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance fab159b1-8768-4266-9a2f-3983628aeb86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d6098213-4199-4660-b36a-ea1908fa9ec8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Migration f4a9c60a-8456-4e01-9930-f701674cbe09 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a3cae7a7-223c-438e-8206-39e0f1683cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing inventories for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating ProviderTree inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing aggregate associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, aggregates: None {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 04:02:38 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing trait associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 04:02:39 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:02:39 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:02:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:02:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.063s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:40 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:40 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:02:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-6d43f26f-dfbb-4299-b875-f498979679d9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:02:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-6d43f26f-dfbb-4299-b875-f498979679d9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:02:40 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:02:40 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'flavor' on Instance uuid d6501f90-9180-4e99-a294-9ffba799c247 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:02:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7cec8290-e3ee-468c-9719-af4a5fe799d4 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "d6501f90-9180-4e99-a294-9ffba799c247" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.171s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:40 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Updating instance_info_cache with network_info: [{"id": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "address": "fa:16:3e:48:2e:c5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c295a9-0e", "ovs_interfaceid": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:02:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-6d43f26f-dfbb-4299-b875-f498979679d9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:02:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:02:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:02:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:43 user nova-compute[74540]: INFO nova.compute.manager [None req-6003903c-a4e6-4785-b1d2-ab6a92eef01f tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Unrescuing
Nov 07 04:02:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6003903c-a4e6-4785-b1d2-ab6a92eef01f tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:02:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6003903c-a4e6-4785-b1d2-ab6a92eef01f tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquired lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:02:43 user nova-compute[74540]: DEBUG nova.network.neutron [None req-6003903c-a4e6-4785-b1d2-ab6a92eef01f tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:02:44 user nova-compute[74540]: DEBUG nova.network.neutron [None req-6003903c-a4e6-4785-b1d2-ab6a92eef01f tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updating instance_info_cache with network_info: [{"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:02:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6003903c-a4e6-4785-b1d2-ab6a92eef01f tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Releasing lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:02:44 user nova-compute[74540]: DEBUG nova.objects.instance [None req-6003903c-a4e6-4785-b1d2-ab6a92eef01f tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lazy-loading 'flavor' on Instance uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:02:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:45 user nova-compute[74540]: DEBUG nova.compute.manager [req-970964eb-a915-4bdf-9a0f-a7725a594218 req-f2e8e127-be5c-4159-9f09-593ba327bd19 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-unplugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-970964eb-a915-4bdf-9a0f-a7725a594218 req-f2e8e127-be5c-4159-9f09-593ba327bd19 service nova] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-970964eb-a915-4bdf-9a0f-a7725a594218 req-f2e8e127-be5c-4159-9f09-593ba327bd19 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-970964eb-a915-4bdf-9a0f-a7725a594218 req-f2e8e127-be5c-4159-9f09-593ba327bd19 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:45 user nova-compute[74540]: DEBUG nova.compute.manager [req-970964eb-a915-4bdf-9a0f-a7725a594218 req-f2e8e127-be5c-4159-9f09-593ba327bd19 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] No waiting events found dispatching network-vif-unplugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:02:45 user nova-compute[74540]: WARNING nova.compute.manager [req-970964eb-a915-4bdf-9a0f-a7725a594218 req-f2e8e127-be5c-4159-9f09-593ba327bd19 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received unexpected event network-vif-unplugged-b624973a-ace1-47d7-8733-2a76e946eaec for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:02:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:45 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Instance destroyed successfully.
Nov 07 04:02:45 user nova-compute[74540]: DEBUG nova.compute.manager [req-d946b965-2ea4-4326-8492-9f07fb98ba8b req-6684e37a-df1e-4d24-8033-a66d043d74de service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-changed-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:45 user nova-compute[74540]: DEBUG nova.compute.manager [req-d946b965-2ea4-4326-8492-9f07fb98ba8b req-6684e37a-df1e-4d24-8033-a66d043d74de service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Refreshing instance network info cache due to event network-changed-b624973a-ace1-47d7-8733-2a76e946eaec. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:02:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d946b965-2ea4-4326-8492-9f07fb98ba8b req-6684e37a-df1e-4d24-8033-a66d043d74de service nova] Acquiring lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:02:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d946b965-2ea4-4326-8492-9f07fb98ba8b req-6684e37a-df1e-4d24-8033-a66d043d74de service nova] Acquired lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:02:45 user nova-compute[74540]: DEBUG nova.network.neutron [req-d946b965-2ea4-4326-8492-9f07fb98ba8b req-6684e37a-df1e-4d24-8033-a66d043d74de service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Refreshing network info cache for port b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:02:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:02:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-625c472c-eb8a-403b-a908-ac3a52eb572f req-6ca23e53-f264-4d10-9a7a-2d4ca1696fe2 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-625c472c-eb8a-403b-a908-ac3a52eb572f req-6ca23e53-f264-4d10-9a7a-2d4ca1696fe2 service nova] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-625c472c-eb8a-403b-a908-ac3a52eb572f req-6ca23e53-f264-4d10-9a7a-2d4ca1696fe2 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-625c472c-eb8a-403b-a908-ac3a52eb572f req-6ca23e53-f264-4d10-9a7a-2d4ca1696fe2 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-625c472c-eb8a-403b-a908-ac3a52eb572f req-6ca23e53-f264-4d10-9a7a-2d4ca1696fe2 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] No waiting events found dispatching network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:02:47 user nova-compute[74540]: WARNING nova.compute.manager [req-625c472c-eb8a-403b-a908-ac3a52eb572f req-6ca23e53-f264-4d10-9a7a-2d4ca1696fe2 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received unexpected event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:02:47 user nova-compute[74540]: WARNING nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid f146d8c3-a189-49da-84d0-b49dc77e4144 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid a3cae7a7-223c-438e-8206-39e0f1683cb0 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid d6501f90-9180-4e99-a294-9ffba799c247 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 6d43f26f-dfbb-4299-b875-f498979679d9 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid d6098213-4199-4660-b36a-ea1908fa9ec8 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 9c425dfc-962a-4d21-ba9b-110fed764c51 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid fab159b1-8768-4266-9a2f-3983628aeb86 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:47 user nova-compute[74540]: INFO nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "d6501f90-9180-4e99-a294-9ffba799c247" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "d6501f90-9180-4e99-a294-9ffba799c247" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "6d43f26f-dfbb-4299-b875-f498979679d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "d6098213-4199-4660-b36a-ea1908fa9ec8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "9c425dfc-962a-4d21-ba9b-110fed764c51" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "fab159b1-8768-4266-9a2f-3983628aeb86" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "fab159b1-8768-4266-9a2f-3983628aeb86" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "d6501f90-9180-4e99-a294-9ffba799c247" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:47 user nova-compute[74540]: INFO nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.180s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.209s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "6d43f26f-dfbb-4299-b875-f498979679d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.204s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.network.neutron [req-d946b965-2ea4-4326-8492-9f07fb98ba8b req-6684e37a-df1e-4d24-8033-a66d043d74de service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updated VIF entry in instance network info cache for port b624973a-ace1-47d7-8733-2a76e946eaec. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG nova.network.neutron [req-d946b965-2ea4-4326-8492-9f07fb98ba8b req-6684e37a-df1e-4d24-8033-a66d043d74de service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updating instance_info_cache with network_info: [{"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.278s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d946b965-2ea4-4326-8492-9f07fb98ba8b req-6684e37a-df1e-4d24-8033-a66d043d74de service nova] Releasing lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:47 user nova-compute[74540]: WARNING nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Instance is unexpectedly not found. Ignore.
Nov 07 04:02:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "fab159b1-8768-4266-9a2f-3983628aeb86" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.384s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-ba6eb02b-354f-4a23-a275-0c143c08661c req-e786aa03-8879-4e14-97ac-b623595c69f9 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-changed-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-ba6eb02b-354f-4a23-a275-0c143c08661c req-e786aa03-8879-4e14-97ac-b623595c69f9 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Refreshing instance network info cache due to event network-changed-b624973a-ace1-47d7-8733-2a76e946eaec. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:02:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ba6eb02b-354f-4a23-a275-0c143c08661c req-e786aa03-8879-4e14-97ac-b623595c69f9 service nova] Acquiring lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:02:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ba6eb02b-354f-4a23-a275-0c143c08661c req-e786aa03-8879-4e14-97ac-b623595c69f9 service nova] Acquired lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:02:48 user nova-compute[74540]: DEBUG nova.network.neutron [req-ba6eb02b-354f-4a23-a275-0c143c08661c req-e786aa03-8879-4e14-97ac-b623595c69f9 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Refreshing network info cache for port b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:02:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:48 user nova-compute[74540]: DEBUG nova.network.neutron [req-ba6eb02b-354f-4a23-a275-0c143c08661c req-e786aa03-8879-4e14-97ac-b623595c69f9 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updated VIF entry in instance network info cache for port b624973a-ace1-47d7-8733-2a76e946eaec. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:02:48 user nova-compute[74540]: DEBUG nova.network.neutron [req-ba6eb02b-354f-4a23-a275-0c143c08661c req-e786aa03-8879-4e14-97ac-b623595c69f9 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updating instance_info_cache with network_info: [{"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:02:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ba6eb02b-354f-4a23-a275-0c143c08661c req-e786aa03-8879-4e14-97ac-b623595c69f9 service nova] Releasing lock "refresh_cache-5a9f46b2-f47c-44a7-9e54-aa167d6c720a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-c7d8beef-4fd1-4b5f-a2eb-11b5a44139d4 req-1e9ac1ec-69c1-4c7d-9b69-72980b4100e5 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7d8beef-4fd1-4b5f-a2eb-11b5a44139d4 req-1e9ac1ec-69c1-4c7d-9b69-72980b4100e5 service nova] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7d8beef-4fd1-4b5f-a2eb-11b5a44139d4 req-1e9ac1ec-69c1-4c7d-9b69-72980b4100e5 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7d8beef-4fd1-4b5f-a2eb-11b5a44139d4 req-1e9ac1ec-69c1-4c7d-9b69-72980b4100e5 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-c7d8beef-4fd1-4b5f-a2eb-11b5a44139d4 req-1e9ac1ec-69c1-4c7d-9b69-72980b4100e5 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] No waiting events found dispatching network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:02:49 user nova-compute[74540]: WARNING nova.compute.manager [req-c7d8beef-4fd1-4b5f-a2eb-11b5a44139d4 req-1e9ac1ec-69c1-4c7d-9b69-72980b4100e5 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received unexpected event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:02:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-c7d8beef-4fd1-4b5f-a2eb-11b5a44139d4 req-1e9ac1ec-69c1-4c7d-9b69-72980b4100e5 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7d8beef-4fd1-4b5f-a2eb-11b5a44139d4 req-1e9ac1ec-69c1-4c7d-9b69-72980b4100e5 service nova] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7d8beef-4fd1-4b5f-a2eb-11b5a44139d4 req-1e9ac1ec-69c1-4c7d-9b69-72980b4100e5 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7d8beef-4fd1-4b5f-a2eb-11b5a44139d4 req-1e9ac1ec-69c1-4c7d-9b69-72980b4100e5 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-c7d8beef-4fd1-4b5f-a2eb-11b5a44139d4 req-1e9ac1ec-69c1-4c7d-9b69-72980b4100e5 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] No waiting events found dispatching network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:02:49 user nova-compute[74540]: WARNING nova.compute.manager [req-c7d8beef-4fd1-4b5f-a2eb-11b5a44139d4 req-1e9ac1ec-69c1-4c7d-9b69-72980b4100e5 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received unexpected event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:02:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6003903c-a4e6-4785-b1d2-ab6a92eef01f tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:02:49 user nova-compute[74540]: INFO nova.compute.claims [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Claim successful on node user
Nov 07 04:02:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:02:50 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:02:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG nova.policy [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47fad238078941dba4cc57406b1c69ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796865203135404b8624363d533ae6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:02:50 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Creating image(s)
Nov 07 04:02:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "/opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "/opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.292s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.241s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk 1073741824" returned: 0 in 0.060s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.243s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Successfully created port: 3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Cannot resize image /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Ensure instance console log exists: /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Successfully updated port: 3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:02:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:02:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquired lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:02:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:02:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Port 27e96706-586b-4c99-9b76-6073a1dda1c8 binding to destination host user is already ACTIVE {{(pid=74540) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 07 04:02:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:02:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquired lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:02:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:02:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-4ced807c-2ba3-43f6-84ed-442fa341cc03 req-d6101e5f-1a44-4de4-9983-930db143d9c9 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-changed-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-4ced807c-2ba3-43f6-84ed-442fa341cc03 req-d6101e5f-1a44-4de4-9983-930db143d9c9 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Refreshing instance network info cache due to event network-changed-3432fa44-5aef-4f35-bc32-9c41738d5eba. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:02:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4ced807c-2ba3-43f6-84ed-442fa341cc03 req-d6101e5f-1a44-4de4-9983-930db143d9c9 service nova] Acquiring lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:02:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updating instance_info_cache with network_info: [{"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Releasing lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Instance network_info: |[{"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4ced807c-2ba3-43f6-84ed-442fa341cc03 req-d6101e5f-1a44-4de4-9983-930db143d9c9 service nova] Acquired lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.network.neutron [req-4ced807c-2ba3-43f6-84ed-442fa341cc03 req-d6101e5f-1a44-4de4-9983-930db143d9c9 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Refreshing network info cache for port 3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Start _get_guest_xml network_info=[{"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:02:53 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:02:53 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1095963237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1095963237',id=16,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5yy6Ou6kxxgeLhllpuYaf0VwnElOEVwXCvSmoufn/x1hVdPoLTWq/xAccmDfVJm0Pb13vhiJ7+4h/8g8wd6kea82ruX/BzZQdz547wqDGDAIFfvjPZ7iXZGlR7HPfLzA==',key_name='tempest-keypair-660584599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='796865203135404b8624363d533ae6fe',ramdisk_id='',reservation_id='r-cso2bngu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-952443794',owner_user_name='tempest-AttachVolumeShelveTestJSON-952443794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:02:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fad238078941dba4cc57406b1c69ed',uuid=6b84cdaa-6964-4e16-95b3-accb9086d871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converting VIF {"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b84cdaa-6964-4e16-95b3-accb9086d871 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating instance_info_cache with network_info: [{"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:02:53 user nova-compute[74540]:   <uuid>6b84cdaa-6964-4e16-95b3-accb9086d871</uuid>
Nov 07 04:02:53 user nova-compute[74540]:   <name>instance-00000010</name>
Nov 07 04:02:53 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:02:53 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:02:53 user nova-compute[74540]:   <metadata>
Nov 07 04:02:53 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:02:53 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:02:53 user nova-compute[74540]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1095963237</nova:name>
Nov 07 04:02:53 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:02:53</nova:creationTime>
Nov 07 04:02:53 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:02:53 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:02:53 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:02:53 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:02:53 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:02:53 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:02:53 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:02:53 user nova-compute[74540]:       <nova:owner>
Nov 07 04:02:53 user nova-compute[74540]:         <nova:user uuid="47fad238078941dba4cc57406b1c69ed">tempest-AttachVolumeShelveTestJSON-952443794-project-member</nova:user>
Nov 07 04:02:53 user nova-compute[74540]:         <nova:project uuid="796865203135404b8624363d533ae6fe">tempest-AttachVolumeShelveTestJSON-952443794</nova:project>
Nov 07 04:02:53 user nova-compute[74540]:       </nova:owner>
Nov 07 04:02:53 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:02:53 user nova-compute[74540]:       <nova:ports>
Nov 07 04:02:53 user nova-compute[74540]:         <nova:port uuid="3432fa44-5aef-4f35-bc32-9c41738d5eba">
Nov 07 04:02:53 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 04:02:53 user nova-compute[74540]:         </nova:port>
Nov 07 04:02:53 user nova-compute[74540]:       </nova:ports>
Nov 07 04:02:53 user nova-compute[74540]:     </nova:instance>
Nov 07 04:02:53 user nova-compute[74540]:   </metadata>
Nov 07 04:02:53 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:02:53 user nova-compute[74540]:     <system>
Nov 07 04:02:53 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:02:53 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:02:53 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:02:53 user nova-compute[74540]:       <entry name="serial">6b84cdaa-6964-4e16-95b3-accb9086d871</entry>
Nov 07 04:02:53 user nova-compute[74540]:       <entry name="uuid">6b84cdaa-6964-4e16-95b3-accb9086d871</entry>
Nov 07 04:02:53 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:02:53 user nova-compute[74540]:     </system>
Nov 07 04:02:53 user nova-compute[74540]:   </sysinfo>
Nov 07 04:02:53 user nova-compute[74540]:   <os>
Nov 07 04:02:53 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:02:53 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:02:53 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:02:53 user nova-compute[74540]:   </os>
Nov 07 04:02:53 user nova-compute[74540]:   <features>
Nov 07 04:02:53 user nova-compute[74540]:     <acpi/>
Nov 07 04:02:53 user nova-compute[74540]:     <apic/>
Nov 07 04:02:53 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:02:53 user nova-compute[74540]:   </features>
Nov 07 04:02:53 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:02:53 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:02:53 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:02:53 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:02:53 user nova-compute[74540]:   </clock>
Nov 07 04:02:53 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:02:53 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:02:53 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:02:53 user nova-compute[74540]:   </cpu>
Nov 07 04:02:53 user nova-compute[74540]:   <devices>
Nov 07 04:02:53 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:02:53 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:02:53 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk"/>
Nov 07 04:02:53 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:02:53 user nova-compute[74540]:     </disk>
Nov 07 04:02:53 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:02:53 user nova-compute[74540]:       <mac address="fa:16:3e:bb:84:42"/>
Nov 07 04:02:53 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:02:53 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:02:53 user nova-compute[74540]:       <target dev="tap3432fa44-5a"/>
Nov 07 04:02:53 user nova-compute[74540]:     </interface>
Nov 07 04:02:53 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:02:53 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/console.log" append="off"/>
Nov 07 04:02:53 user nova-compute[74540]:     </serial>
Nov 07 04:02:53 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:02:53 user nova-compute[74540]:     <video>
Nov 07 04:02:53 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:02:53 user nova-compute[74540]:     </video>
Nov 07 04:02:53 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:02:53 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:02:53 user nova-compute[74540]:     </rng>
Nov 07 04:02:53 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:02:53 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:02:53 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:02:53 user nova-compute[74540]:     </memballoon>
Nov 07 04:02:53 user nova-compute[74540]:   </devices>
Nov 07 04:02:53 user nova-compute[74540]: </domain>
Nov 07 04:02:53 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1095963237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1095963237',id=16,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5yy6Ou6kxxgeLhllpuYaf0VwnElOEVwXCvSmoufn/x1hVdPoLTWq/xAccmDfVJm0Pb13vhiJ7+4h/8g8wd6kea82ruX/BzZQdz547wqDGDAIFfvjPZ7iXZGlR7HPfLzA==',key_name='tempest-keypair-660584599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='796865203135404b8624363d533ae6fe',ramdisk_id='',reservation_id='r-cso2bngu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-952443794',owner_user_name='tempest-AttachVolumeShelveTestJSON-952443794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:02:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fad238078941dba4cc57406b1c69ed',uuid=6b84cdaa-6964-4e16-95b3-accb9086d871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converting VIF {"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG os_vif [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd323124-cc15-5ba8-9574-41fb536355af', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Releasing lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3432fa44-5a, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3432fa44-5a, col_values=(('qos', UUID('77140bfd-b390-4765-921b-9e45a464f0bd')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3432fa44-5a, col_values=(('external_ids', {'iface-id': '3432fa44-5aef-4f35-bc32-9c41738d5eba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:84:42', 'vm-uuid': '6b84cdaa-6964-4e16-95b3-accb9086d871'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Creating tmpfile /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/tmp393vsx4v to verify with other compute node that the instance is on the same shared storage. {{(pid=74540) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:53 user nova-compute[74540]: INFO os_vif [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a')
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] No VIF found with MAC fa:16:3e:bb:84:42, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-1d968175-75a1-46ed-a80d-9e3d8b88b466 req-f695eb07-ba71-4686-a970-d24db3ec32ef service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-unplugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1d968175-75a1-46ed-a80d-9e3d8b88b466 req-f695eb07-ba71-4686-a970-d24db3ec32ef service nova] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1d968175-75a1-46ed-a80d-9e3d8b88b466 req-f695eb07-ba71-4686-a970-d24db3ec32ef service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1d968175-75a1-46ed-a80d-9e3d8b88b466 req-f695eb07-ba71-4686-a970-d24db3ec32ef service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-1d968175-75a1-46ed-a80d-9e3d8b88b466 req-f695eb07-ba71-4686-a970-d24db3ec32ef service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] No waiting events found dispatching network-vif-unplugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:02:53 user nova-compute[74540]: WARNING nova.compute.manager [req-1d968175-75a1-46ed-a80d-9e3d8b88b466 req-f695eb07-ba71-4686-a970-d24db3ec32ef service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received unexpected event network-vif-unplugged-27e96706-586b-4c99-9b76-6073a1dda1c8 for instance with vm_state resized and task_state resize_reverting.
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.network.neutron [req-4ced807c-2ba3-43f6-84ed-442fa341cc03 req-d6101e5f-1a44-4de4-9983-930db143d9c9 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updated VIF entry in instance network info cache for port 3432fa44-5aef-4f35-bc32-9c41738d5eba. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG nova.network.neutron [req-4ced807c-2ba3-43f6-84ed-442fa341cc03 req-d6101e5f-1a44-4de4-9983-930db143d9c9 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updating instance_info_cache with network_info: [{"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:02:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4ced807c-2ba3-43f6-84ed-442fa341cc03 req-d6101e5f-1a44-4de4-9983-930db143d9c9 service nova] Releasing lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:02:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Instance destroyed successfully.
Nov 07 04:02:54 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lazy-loading 'resources' on Instance uuid a3cae7a7-223c-438e-8206-39e0f1683cb0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1210052302',display_name='tempest-ServerActionsTestOtherB-server-1210052302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1210052302',id=4,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA4sa8gttNcUVG7dP3QNit/DgVEny+5q14Y5Nq4fULGEJH2XetZ4c/LpN/MeE1MeKbjuGhXIPyx37hOCdT8fI0kPAEfe6XDcs5qqFJVn5zBv9qgxSc44xeWnPbfk+DcLA==',key_name='tempest-keypair-1859375338',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:01:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ede989d4b3d34f1b996f135913039586',ramdisk_id='',reservation_id='r-kydyio2y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-414073346',owner_user_name='tempest-ServerActionsTestOtherB-414073346-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:01:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0218f41629a9468f80011fb04e917600',uuid=a3cae7a7-223c-438e-8206-39e0f1683cb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converting VIF {"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_vif [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27e96706-58, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ec8bf3b-2ba9-4a2b-9781-78afd0d1cfe4) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:54 user nova-compute[74540]: INFO os_vif [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58')
Nov 07 04:02:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSskdBKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:02:54 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6535188-c619-49b6-9c95-c8faf558309a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:02:54 user nova-compute[74540]: No targets found.
Nov 07 04:02:54 user nova-compute[74540]: iSNS:
Nov 07 04:02:54 user nova-compute[74540]: No targets found.
Nov 07 04:02:54 user nova-compute[74540]: STATIC:
Nov 07 04:02:54 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:02:54 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:02:54 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:02:54 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:02:54 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:02:54 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:02:54 user nova-compute[74540]: FIRMWARE:
Nov 07 04:02:54 user nova-compute[74540]: No targets found.
Nov 07 04:02:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:02:54 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:02:54 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[325a9dae-08e5-4a0b-b66b-569708ef15cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[46078dcb-635a-43e3-9b0d-ec7f2c47b838]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:02:54 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:02:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:02:54 user nova-compute[74540]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:02:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc2ebac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8'): ({'sde'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Removing single pathed devices sde {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27f11f3-63cf-4f95-9875-1cd3746fa093]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01ce8be-e5b5-4a4e-bb89-4efe5a4e3c08]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Flushing IO for device /dev/sde {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cfc968-b731-44b9-adf9-51700a58eec4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[160e9ad9-fc08-488c-8013-67bbab7e09a7]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] SCSI volumes sde have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfa75b9-3c00-419e-a3ec-36a7b86573ca]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f4b979-382a-4077-a15a-509b0c55170b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260]
Nov 07 04:02:54 user nova-compute[74540]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260] successful.
Nov 07 04:02:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:02:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9667c59-ebef-440d-ba62-19875fb67733]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] <== disconnect_volume: return (345ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-0b6dadfe-00c3-484d-b5a1-c3017b1d7e6d req-277c5760-fddc-42bd-8675-9dbd1a29f0f9 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0b6dadfe-00c3-484d-b5a1-c3017b1d7e6d req-277c5760-fddc-42bd-8675-9dbd1a29f0f9 service nova] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0b6dadfe-00c3-484d-b5a1-c3017b1d7e6d req-277c5760-fddc-42bd-8675-9dbd1a29f0f9 service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0b6dadfe-00c3-484d-b5a1-c3017b1d7e6d req-277c5760-fddc-42bd-8675-9dbd1a29f0f9 service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-0b6dadfe-00c3-484d-b5a1-c3017b1d7e6d req-277c5760-fddc-42bd-8675-9dbd1a29f0f9 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] No waiting events found dispatching network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:02:55 user nova-compute[74540]: WARNING nova.compute.manager [req-0b6dadfe-00c3-484d-b5a1-c3017b1d7e6d req-277c5760-fddc-42bd-8675-9dbd1a29f0f9 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received unexpected event network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba for instance with vm_state building and task_state spawning.
Nov 07 04:02:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-afb5876c-9b12-4ff8-a64b-9f3f732d6c46 req-b3006115-d94c-46f8-a143-e527e4dc678f service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-afb5876c-9b12-4ff8-a64b-9f3f732d6c46 req-b3006115-d94c-46f8-a143-e527e4dc678f service nova] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-afb5876c-9b12-4ff8-a64b-9f3f732d6c46 req-b3006115-d94c-46f8-a143-e527e4dc678f service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-afb5876c-9b12-4ff8-a64b-9f3f732d6c46 req-b3006115-d94c-46f8-a143-e527e4dc678f service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-afb5876c-9b12-4ff8-a64b-9f3f732d6c46 req-b3006115-d94c-46f8-a143-e527e4dc678f service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] No waiting events found dispatching network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:02:55 user nova-compute[74540]: WARNING nova.compute.manager [req-afb5876c-9b12-4ff8-a64b-9f3f732d6c46 req-b3006115-d94c-46f8-a143-e527e4dc678f service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received unexpected event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 for instance with vm_state resized and task_state resize_reverting.
Nov 07 04:02:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:02:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:56 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lazy-loading 'migration_context' on Instance uuid a3cae7a7-223c-438e-8206-39e0f1683cb0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:02:56 user nova-compute[74540]: DEBUG nova.objects.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Object Instance<a3cae7a7-223c-438e-8206-39e0f1683cb0> lazy-loaded attributes: resources,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:02:56 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:02:56 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:02:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.605s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:57 user nova-compute[74540]: INFO nova.compute.manager [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Swapping old allocation on dict_keys(['6fab23dc-967a-41e4-85df-347deed7f4ba']) held by migration f4a9c60a-8456-4e01-9930-f701674cbe09 for instance
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Overwriting current allocation {'allocations': {'6fab23dc-967a-41e4-85df-347deed7f4ba': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 20}}, 'project_id': 'ede989d4b3d34f1b996f135913039586', 'user_id': '0218f41629a9468f80011fb04e917600', 'consumer_generation': 1} on consumer a3cae7a7-223c-438e-8206-39e0f1683cb0 {{(pid=74540) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquired lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-fcc6b9ea-8fe2-4148-ad5d-85d4b06e8af5 req-ff71498f-69dc-4d2e-9bed-7431a3ca950d service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fcc6b9ea-8fe2-4148-ad5d-85d4b06e8af5 req-ff71498f-69dc-4d2e-9bed-7431a3ca950d service nova] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fcc6b9ea-8fe2-4148-ad5d-85d4b06e8af5 req-ff71498f-69dc-4d2e-9bed-7431a3ca950d service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fcc6b9ea-8fe2-4148-ad5d-85d4b06e8af5 req-ff71498f-69dc-4d2e-9bed-7431a3ca950d service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-fcc6b9ea-8fe2-4148-ad5d-85d4b06e8af5 req-ff71498f-69dc-4d2e-9bed-7431a3ca950d service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] No waiting events found dispatching network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:02:57 user nova-compute[74540]: WARNING nova.compute.manager [req-fcc6b9ea-8fe2-4148-ad5d-85d4b06e8af5 req-ff71498f-69dc-4d2e-9bed-7431a3ca950d service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received unexpected event network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba for instance with vm_state building and task_state spawning.
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating instance_info_cache with network_info: [{"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:02:57 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Instance spawned successfully.
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Releasing lock "refresh_cache-a3cae7a7-223c-438e-8206-39e0f1683cb0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG os_brick.utils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb0aecc-9e15-43ea-ba89-7fe2feefe724]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4983049a-e5f5-4b3b-97dc-ed67dc7c708d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:02:57 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d0c179-7107-4b45-8e57-090aae8ef841]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6bde00-5603-42e5-990b-8be87f0962f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:02:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:02:58 user nova-compute[74540]: INFO nova.compute.manager [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 07 04:02:58 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:02:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:02:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:02:58 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:02:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e355cb73-dc3b-4ad6-a501-cd4a97049e5b]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:02:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:02:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:02:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:02:58 user nova-compute[74540]: DEBUG os_brick.utils [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:02:58 user nova-compute[74540]: INFO nova.compute.manager [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Took 8.38 seconds to build instance.
Nov 07 04:02:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e09f81cf-9752-41ad-8914-aec53113dd93 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.490s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:02:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "d6501f90-9180-4e99-a294-9ffba799c247" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "d6501f90-9180-4e99-a294-9ffba799c247" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "d6501f90-9180-4e99-a294-9ffba799c247-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "d6501f90-9180-4e99-a294-9ffba799c247-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "d6501f90-9180-4e99-a294-9ffba799c247-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:04 user nova-compute[74540]: INFO nova.compute.manager [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Terminating instance
Nov 07 04:03:04 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:03:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-3c23eaf6-5109-45fe-b934-90d03bd52254 req-eddc2a85-fb5f-4032-9832-01e0dbaf4b3d service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Received event network-vif-unplugged-ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3c23eaf6-5109-45fe-b934-90d03bd52254 req-eddc2a85-fb5f-4032-9832-01e0dbaf4b3d service nova] Acquiring lock "d6501f90-9180-4e99-a294-9ffba799c247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3c23eaf6-5109-45fe-b934-90d03bd52254 req-eddc2a85-fb5f-4032-9832-01e0dbaf4b3d service nova] Lock "d6501f90-9180-4e99-a294-9ffba799c247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3c23eaf6-5109-45fe-b934-90d03bd52254 req-eddc2a85-fb5f-4032-9832-01e0dbaf4b3d service nova] Lock "d6501f90-9180-4e99-a294-9ffba799c247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-3c23eaf6-5109-45fe-b934-90d03bd52254 req-eddc2a85-fb5f-4032-9832-01e0dbaf4b3d service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] No waiting events found dispatching network-vif-unplugged-ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-3c23eaf6-5109-45fe-b934-90d03bd52254 req-eddc2a85-fb5f-4032-9832-01e0dbaf4b3d service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Received event network-vif-unplugged-ec97afff-dfc2-423f-b6d9-7f0e807144d9 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:05 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Instance destroyed successfully.
Nov 07 04:03:05 user nova-compute[74540]: DEBUG nova.objects.instance [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'resources' on Instance uuid d6501f90-9180-4e99-a294-9ffba799c247 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-262183128',display_name='tempest-AttachVolumeNegativeTest-server-262183128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-262183128',id=5,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKpD6jUYS81AtBS3ueqZbGiPtxN7xY0V8Ks87Y2co8ZG740R4n2gTBhlxDBh22BOu1hvKLeyAPrb6+ywzuEhI6YajgPnJbKsQS4vVEyRtxm10Ym/BZQGU70LLdM6aY5qg==',key_name='tempest-keypair-1722906034',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:56:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='620cefdadcec49d6a696aa7db8cef2d1',ramdisk_id='',reservation_id='r-eh638zor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-306463361',owner_user_name='tempest-AttachVolumeNegativeTest-306463361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:56:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3079ba3a84ea4b4bb4a3e576ab4133ae',uuid=d6501f90-9180-4e99-a294-9ffba799c247,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "address": "fa:16:3e:5c:97:16", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec97afff-df", "ovs_interfaceid": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converting VIF {"id": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "address": "fa:16:3e:5c:97:16", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec97afff-df", "ovs_interfaceid": "ec97afff-dfc2-423f-b6d9-7f0e807144d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:97:16,bridge_name='br-int',has_traffic_filtering=True,id=ec97afff-dfc2-423f-b6d9-7f0e807144d9,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec97afff-df') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG os_vif [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:97:16,bridge_name='br-int',has_traffic_filtering=True,id=ec97afff-dfc2-423f-b6d9-7f0e807144d9,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec97afff-df') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec97afff-df, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "d6098213-4199-4660-b36a-ea1908fa9ec8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:05 user nova-compute[74540]: INFO nova.compute.manager [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Terminating instance
Nov 07 04:03:05 user nova-compute[74540]: DEBUG nova.compute.manager [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15e77147-27a4-4917-96f6-ebe2018a344d) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:03:05 user nova-compute[74540]: INFO os_vif [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:97:16,bridge_name='br-int',has_traffic_filtering=True,id=ec97afff-dfc2-423f-b6d9-7f0e807144d9,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec97afff-df')
Nov 07 04:03:05 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Deleting instance files /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247_del
Nov 07 04:03:05 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Deletion of /opt/stack/data/nova/instances/d6501f90-9180-4e99-a294-9ffba799c247_del complete
Nov 07 04:03:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:05 user nova-compute[74540]: INFO nova.compute.manager [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 07 04:03:05 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: d6501f90-9180-4e99-a294-9ffba799c247] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:03:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Instance destroyed successfully.
Nov 07 04:03:06 user nova-compute[74540]: DEBUG nova.objects.instance [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lazy-loading 'resources' on Instance uuid d6098213-4199-4660-b36a-ea1908fa9ec8 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1188154359',display_name='tempest-VolumesAdminNegativeTest-server-1188154359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1188154359',id=14,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:01:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22541886dbac4b43a412699358e12f25',ramdisk_id='',reservation_id='r-awszjm3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1758788930',owner_user_name='tempest-VolumesAdminNegativeTest-1758788930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:01:05Z,user_data=None,user_id='72436e7806974d159635dc3d86785dff',uuid=d6098213-4199-4660-b36a-ea1908fa9ec8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f81041f-3336-4182-95a4-95d2fc406e96", "address": "fa:16:3e:5a:ce:f5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f81041f-33", "ovs_interfaceid": "4f81041f-3336-4182-95a4-95d2fc406e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Converting VIF {"id": "4f81041f-3336-4182-95a4-95d2fc406e96", "address": "fa:16:3e:5a:ce:f5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f81041f-33", "ovs_interfaceid": "4f81041f-3336-4182-95a4-95d2fc406e96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:f5,bridge_name='br-int',has_traffic_filtering=True,id=4f81041f-3336-4182-95a4-95d2fc406e96,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f81041f-33') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG os_vif [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:f5,bridge_name='br-int',has_traffic_filtering=True,id=4f81041f-3336-4182-95a4-95d2fc406e96,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f81041f-33') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f81041f-33, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d9a47a8-41b0-45ab-b411-6b83a11762c5) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:03:06 user nova-compute[74540]: INFO os_vif [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ce:f5,bridge_name='br-int',has_traffic_filtering=True,id=4f81041f-3336-4182-95a4-95d2fc406e96,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f81041f-33')
Nov 07 04:03:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Deleting instance files /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8_del
Nov 07 04:03:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Deletion of /opt/stack/data/nova/instances/d6098213-4199-4660-b36a-ea1908fa9ec8_del complete
Nov 07 04:03:06 user nova-compute[74540]: INFO nova.compute.manager [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 07 04:03:06 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:03:06 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Took 1.04 seconds to deallocate network for instance.
Nov 07 04:03:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-39ed38e7-eb82-4107-a456-e69a04214471 req-c57d9c18-2571-410f-b154-0bd2fa2d0686 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Received event network-vif-deleted-ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Received event network-vif-plugged-ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] Acquiring lock "d6501f90-9180-4e99-a294-9ffba799c247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] Lock "d6501f90-9180-4e99-a294-9ffba799c247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] Lock "d6501f90-9180-4e99-a294-9ffba799c247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] No waiting events found dispatching network-vif-plugged-ec97afff-dfc2-423f-b6d9-7f0e807144d9 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:07 user nova-compute[74540]: WARNING nova.compute.manager [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] [instance: d6501f90-9180-4e99-a294-9ffba799c247] Received unexpected event network-vif-plugged-ec97afff-dfc2-423f-b6d9-7f0e807144d9 for instance with vm_state deleted and task_state None.
Nov 07 04:03:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Received event network-vif-unplugged-4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] Acquiring lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] No waiting events found dispatching network-vif-unplugged-4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Received event network-vif-unplugged-4f81041f-3336-4182-95a4-95d2fc406e96 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Received event network-vif-plugged-4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] Acquiring lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] No waiting events found dispatching network-vif-plugged-4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:07 user nova-compute[74540]: WARNING nova.compute.manager [req-faef6bd7-dae9-4c81-b3f6-51bf4d5f1d77 req-e54a64b3-5dc4-4712-9161-2e765c760ee7 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Received unexpected event network-vif-plugged-4f81041f-3336-4182-95a4-95d2fc406e96 for instance with vm_state active and task_state deleting.
Nov 07 04:03:07 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.564s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:03:07 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Deleted allocations for instance d6501f90-9180-4e99-a294-9ffba799c247
Nov 07 04:03:07 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Took 0.87 seconds to deallocate network for instance.
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a17cc861-4eed-4c31-a0de-a0da37f4c175 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "d6501f90-9180-4e99-a294-9ffba799c247" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.831s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:03:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:08 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Deleted allocations for instance d6098213-4199-4660-b36a-ea1908fa9ec8
Nov 07 04:03:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1051dfa3-fca5-4f9e-989e-2097b4feffb8 tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "d6098213-4199-4660-b36a-ea1908fa9ec8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.513s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-7186b363-e88c-440f-b6da-ce5843dcfcf9 req-18026792-757f-4c36-82b9-2aaa6cfc3134 service nova] [instance: d6098213-4199-4660-b36a-ea1908fa9ec8] Received event network-vif-deleted-4f81041f-3336-4182-95a4-95d2fc406e96 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:14 user nova-compute[74540]: INFO nova.compute.manager [None req-b855fa93-2349-48cd-86e2-5a7ab43e929c tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Unrescuing
Nov 07 04:03:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b855fa93-2349-48cd-86e2-5a7ab43e929c tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:03:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b855fa93-2349-48cd-86e2-5a7ab43e929c tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquired lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:03:14 user nova-compute[74540]: DEBUG nova.network.neutron [None req-b855fa93-2349-48cd-86e2-5a7ab43e929c tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:03:14 user nova-compute[74540]: DEBUG nova.network.neutron [None req-b855fa93-2349-48cd-86e2-5a7ab43e929c tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updating instance_info_cache with network_info: [{"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:03:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b855fa93-2349-48cd-86e2-5a7ab43e929c tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Releasing lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:03:14 user nova-compute[74540]: DEBUG nova.objects.instance [None req-b855fa93-2349-48cd-86e2-5a7ab43e929c tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'flavor' on Instance uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:03:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-98f22b2c-4593-4371-aac1-c7a3d84183fd req-30d202aa-148c-4198-8d2d-04fe818e3c12 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-unplugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-98f22b2c-4593-4371-aac1-c7a3d84183fd req-30d202aa-148c-4198-8d2d-04fe818e3c12 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-98f22b2c-4593-4371-aac1-c7a3d84183fd req-30d202aa-148c-4198-8d2d-04fe818e3c12 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-98f22b2c-4593-4371-aac1-c7a3d84183fd req-30d202aa-148c-4198-8d2d-04fe818e3c12 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-98f22b2c-4593-4371-aac1-c7a3d84183fd req-30d202aa-148c-4198-8d2d-04fe818e3c12 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-unplugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:15 user nova-compute[74540]: WARNING nova.compute.manager [req-98f22b2c-4593-4371-aac1-c7a3d84183fd req-30d202aa-148c-4198-8d2d-04fe818e3c12 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-unplugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:03:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:15 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Instance destroyed successfully.
Nov 07 04:03:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:17 user nova-compute[74540]: WARNING nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:03:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:17 user nova-compute[74540]: WARNING nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:03:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:17 user nova-compute[74540]: WARNING nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:03:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-unplugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-unplugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:17 user nova-compute[74540]: WARNING nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-unplugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:03:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:17 user nova-compute[74540]: WARNING nova.compute.manager [req-72bfca4c-81ae-431e-9745-774591c40b80 req-e8c17e4c-c156-4e7c-9503-8ba2cae734c2 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:03:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:18 user nova-compute[74540]: INFO nova.compute.manager [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Detaching volume 196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:03:18 user nova-compute[74540]: INFO nova.virt.block_device [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Attempting to driver detach volume 196b6636-9efd-4905-b7a2-36a457b6818d from mountpoint /dev/vdb
Nov 07 04:03:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Attempting to detach device vdb from instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:03:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:03:18 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:03:18 user nova-compute[74540]:   <source dev="/dev/sdg"/>
Nov 07 04:03:18 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:03:18 user nova-compute[74540]:   <serial>196b6636-9efd-4905-b7a2-36a457b6818d</serial>
Nov 07 04:03:18 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:03:18 user nova-compute[74540]: </disk>
Nov 07 04:03:18 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:03:18 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Successfully detached device vdb from instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a from the persistent domain config.
Nov 07 04:03:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:03:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:03:18 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:03:18 user nova-compute[74540]:   <source dev="/dev/sdg"/>
Nov 07 04:03:18 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:03:18 user nova-compute[74540]:   <serial>196b6636-9efd-4905-b7a2-36a457b6818d</serial>
Nov 07 04:03:18 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:03:18 user nova-compute[74540]: </disk>
Nov 07 04:03:18 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:03:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:03:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-68a91dbf-f7fe-479d-8090-f227c82e8dfc req-32f1c613-ebc4-4b6a-8c4d-0d2f1d58e3e7 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-68a91dbf-f7fe-479d-8090-f227c82e8dfc req-32f1c613-ebc4-4b6a-8c4d-0d2f1d58e3e7 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-68a91dbf-f7fe-479d-8090-f227c82e8dfc req-32f1c613-ebc4-4b6a-8c4d-0d2f1d58e3e7 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-68a91dbf-f7fe-479d-8090-f227c82e8dfc req-32f1c613-ebc4-4b6a-8c4d-0d2f1d58e3e7 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-68a91dbf-f7fe-479d-8090-f227c82e8dfc req-32f1c613-ebc4-4b6a-8c4d-0d2f1d58e3e7 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:19 user nova-compute[74540]: WARNING nova.compute.manager [req-68a91dbf-f7fe-479d-8090-f227c82e8dfc req-32f1c613-ebc4-4b6a-8c4d-0d2f1d58e3e7 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:03:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-68a91dbf-f7fe-479d-8090-f227c82e8dfc req-32f1c613-ebc4-4b6a-8c4d-0d2f1d58e3e7 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-68a91dbf-f7fe-479d-8090-f227c82e8dfc req-32f1c613-ebc4-4b6a-8c4d-0d2f1d58e3e7 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-68a91dbf-f7fe-479d-8090-f227c82e8dfc req-32f1c613-ebc4-4b6a-8c4d-0d2f1d58e3e7 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-68a91dbf-f7fe-479d-8090-f227c82e8dfc req-32f1c613-ebc4-4b6a-8c4d-0d2f1d58e3e7 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-68a91dbf-f7fe-479d-8090-f227c82e8dfc req-32f1c613-ebc4-4b6a-8c4d-0d2f1d58e3e7 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:19 user nova-compute[74540]: WARNING nova.compute.manager [req-68a91dbf-f7fe-479d-8090-f227c82e8dfc req-32f1c613-ebc4-4b6a-8c4d-0d2f1d58e3e7 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:03:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-b855fa93-2349-48cd-86e2-5a7ab43e929c tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:03:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Starting finish_revert_migration {{(pid=74540) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Start _get_guest_xml network_info=[{"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSskdBKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a3cae7a7-223c-438e-8206-39e0f1683cb0', 'attached_at': '2023-11-07T04:03:23.000000', 'detached_at': '', 'volume_id': '615b5148-e91d-4c64-8ad2-084c8f7108e8', 'serial': '615b5148-e91d-4c64-8ad2-084c8f7108e8'}, 'boot_index': None, 'attachment_id': '91eb8b03-77b4-4247-a96e-d8bc575376fe', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:03:22 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:03:22 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:03:22 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3cae7a7-223c-438e-8206-39e0f1683cb0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSskdBKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:03:23 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:03:23 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:03:23 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacd27e5-85cb-4bb6-8c5a-e0820d00aebf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:03:23 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba15143a-fb07-4494-ae50-85f3f66969fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8] added
Nov 07 04:03:23 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8b69eb-53ac-40bf-b7f5-0c4a9c25da6f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[331127a9-8771-4d4b-8961-e5e0e67d5f8a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSskdBKW {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSskdBKW" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39881de-98d4-4e12-a57b-ec2e35aa08ee]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uSskdBKW'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aed7b2a-25a5-45c7-a8ea-db15685ce9f1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5155b1de-e0f1-4b13-9a09-92ef646bb0ff]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:03:23 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:03:23 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3d0082-fa3b-443b-a10a-3673c4685bc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260]
Nov 07 04:03:23 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260] successful.
Nov 07 04:03:23 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42c0ef6-9b2a-4211-b05c-f1dfce712c68]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a708f549-acd8-4fee-976a-19458daf0990]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:03:23 user nova-compute[74540]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:03:23 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:03:23 user nova-compute[74540]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:03:23 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69f41f1-5946-4813-8d10-3b03d0ba1372]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:23 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSskdBKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23531343931393763', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531343931393763', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1210052302',display_name='tempest-ServerActionsTestOtherB-server-1210052302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1210052302',id=4,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA4sa8gttNcUVG7dP3QNit/DgVEny+5q14Y5Nq4fULGEJH2XetZ4c/LpN/MeE1MeKbjuGhXIPyx37hOCdT8fI0kPAEfe6XDcs5qqFJVn5zBv9qgxSc44xeWnPbfk+DcLA==',key_name='tempest-keypair-1859375338',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:01:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ede989d4b3d34f1b996f135913039586',ramdisk_id='',reservation_id='r-kydyio2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-414073346',owner_user_name='tempest-ServerActionsTestOtherB-414073346-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0218f41629a9468f80011fb04e917600',uuid=a3cae7a7-223c-438e-8206-39e0f1683cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converting VIF {"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:03:24 user nova-compute[74540]:   <uuid>a3cae7a7-223c-438e-8206-39e0f1683cb0</uuid>
Nov 07 04:03:24 user nova-compute[74540]:   <name>instance-00000004</name>
Nov 07 04:03:24 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:03:24 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:03:24 user nova-compute[74540]:   <metadata>
Nov 07 04:03:24 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:03:24 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:03:24 user nova-compute[74540]:       <nova:name>tempest-ServerActionsTestOtherB-server-1210052302</nova:name>
Nov 07 04:03:24 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:03:22</nova:creationTime>
Nov 07 04:03:24 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:03:24 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:03:24 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:03:24 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:03:24 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:03:24 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:03:24 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:03:24 user nova-compute[74540]:       <nova:owner>
Nov 07 04:03:24 user nova-compute[74540]:         <nova:user uuid="0218f41629a9468f80011fb04e917600">tempest-ServerActionsTestOtherB-414073346-project-member</nova:user>
Nov 07 04:03:24 user nova-compute[74540]:         <nova:project uuid="ede989d4b3d34f1b996f135913039586">tempest-ServerActionsTestOtherB-414073346</nova:project>
Nov 07 04:03:24 user nova-compute[74540]:       </nova:owner>
Nov 07 04:03:24 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:03:24 user nova-compute[74540]:       <nova:ports>
Nov 07 04:03:24 user nova-compute[74540]:         <nova:port uuid="27e96706-586b-4c99-9b76-6073a1dda1c8">
Nov 07 04:03:24 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 07 04:03:24 user nova-compute[74540]:         </nova:port>
Nov 07 04:03:24 user nova-compute[74540]:       </nova:ports>
Nov 07 04:03:24 user nova-compute[74540]:     </nova:instance>
Nov 07 04:03:24 user nova-compute[74540]:   </metadata>
Nov 07 04:03:24 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:03:24 user nova-compute[74540]:     <system>
Nov 07 04:03:24 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:03:24 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:03:24 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:03:24 user nova-compute[74540]:       <entry name="serial">a3cae7a7-223c-438e-8206-39e0f1683cb0</entry>
Nov 07 04:03:24 user nova-compute[74540]:       <entry name="uuid">a3cae7a7-223c-438e-8206-39e0f1683cb0</entry>
Nov 07 04:03:24 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:03:24 user nova-compute[74540]:     </system>
Nov 07 04:03:24 user nova-compute[74540]:   </sysinfo>
Nov 07 04:03:24 user nova-compute[74540]:   <os>
Nov 07 04:03:24 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:03:24 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:03:24 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:03:24 user nova-compute[74540]:   </os>
Nov 07 04:03:24 user nova-compute[74540]:   <features>
Nov 07 04:03:24 user nova-compute[74540]:     <acpi/>
Nov 07 04:03:24 user nova-compute[74540]:     <apic/>
Nov 07 04:03:24 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:03:24 user nova-compute[74540]:   </features>
Nov 07 04:03:24 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:03:24 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:03:24 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:03:24 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:03:24 user nova-compute[74540]:   </clock>
Nov 07 04:03:24 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:03:24 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:03:24 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:03:24 user nova-compute[74540]:   </cpu>
Nov 07 04:03:24 user nova-compute[74540]:   <devices>
Nov 07 04:03:24 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:03:24 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:03:24 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk"/>
Nov 07 04:03:24 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:03:24 user nova-compute[74540]:     </disk>
Nov 07 04:03:24 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:03:24 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:03:24 user nova-compute[74540]:       <source dev="/dev/sdb"/>
Nov 07 04:03:24 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 04:03:24 user nova-compute[74540]:       <serial>615b5148-e91d-4c64-8ad2-084c8f7108e8</serial>
Nov 07 04:03:24 user nova-compute[74540]:     </disk>
Nov 07 04:03:24 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:03:24 user nova-compute[74540]:       <mac address="fa:16:3e:6b:66:f7"/>
Nov 07 04:03:24 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:03:24 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:03:24 user nova-compute[74540]:       <target dev="tap27e96706-58"/>
Nov 07 04:03:24 user nova-compute[74540]:     </interface>
Nov 07 04:03:24 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:03:24 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/console.log" append="off"/>
Nov 07 04:03:24 user nova-compute[74540]:     </serial>
Nov 07 04:03:24 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:03:24 user nova-compute[74540]:     <video>
Nov 07 04:03:24 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:03:24 user nova-compute[74540]:     </video>
Nov 07 04:03:24 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:03:24 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:03:24 user nova-compute[74540]:     </rng>
Nov 07 04:03:24 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:03:24 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:03:24 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:03:24 user nova-compute[74540]:     </memballoon>
Nov 07 04:03:24 user nova-compute[74540]:   </devices>
Nov 07 04:03:24 user nova-compute[74540]: </domain>
Nov 07 04:03:24 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1210052302',display_name='tempest-ServerActionsTestOtherB-server-1210052302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1210052302',id=4,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA4sa8gttNcUVG7dP3QNit/DgVEny+5q14Y5Nq4fULGEJH2XetZ4c/LpN/MeE1MeKbjuGhXIPyx37hOCdT8fI0kPAEfe6XDcs5qqFJVn5zBv9qgxSc44xeWnPbfk+DcLA==',key_name='tempest-keypair-1859375338',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:01:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ede989d4b3d34f1b996f135913039586',ramdisk_id='',reservation_id='r-kydyio2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-414073346',owner_user_name='tempest-ServerActionsTestOtherB-414073346-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0218f41629a9468f80011fb04e917600',uuid=a3cae7a7-223c-438e-8206-39e0f1683cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converting VIF {"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG os_vif [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fd51662-8103-509f-8fce-b6cb2ac043d4', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27e96706-58, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27e96706-58, col_values=(('qos', UUID('a241868e-4790-439e-a08f-805053ddeba4')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27e96706-58, col_values=(('external_ids', {'iface-id': '27e96706-586b-4c99-9b76-6073a1dda1c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:66:f7', 'vm-uuid': 'a3cae7a7-223c-438e-8206-39e0f1683cb0'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:03:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:24 user nova-compute[74540]: INFO os_vif [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58')
Nov 07 04:03:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-c6bfefb1-9751-4358-b2dc-ed6f2eb1117d req-059d5a8a-c588-4486-a017-e3c02c5243fd service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c6bfefb1-9751-4358-b2dc-ed6f2eb1117d req-059d5a8a-c588-4486-a017-e3c02c5243fd service nova] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c6bfefb1-9751-4358-b2dc-ed6f2eb1117d req-059d5a8a-c588-4486-a017-e3c02c5243fd service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c6bfefb1-9751-4358-b2dc-ed6f2eb1117d req-059d5a8a-c588-4486-a017-e3c02c5243fd service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-c6bfefb1-9751-4358-b2dc-ed6f2eb1117d req-059d5a8a-c588-4486-a017-e3c02c5243fd service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] No waiting events found dispatching network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:26 user nova-compute[74540]: WARNING nova.compute.manager [req-c6bfefb1-9751-4358-b2dc-ed6f2eb1117d req-059d5a8a-c588-4486-a017-e3c02c5243fd service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received unexpected event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 for instance with vm_state resized and task_state resize_reverting.
Nov 07 04:03:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:03:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-7550cbc6-653d-4a6b-9ce8-be65c912382f req-b6954768-d27f-418e-9c15-06adf5a5b0ea service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7550cbc6-653d-4a6b-9ce8-be65c912382f req-b6954768-d27f-418e-9c15-06adf5a5b0ea service nova] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7550cbc6-653d-4a6b-9ce8-be65c912382f req-b6954768-d27f-418e-9c15-06adf5a5b0ea service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7550cbc6-653d-4a6b-9ce8-be65c912382f req-b6954768-d27f-418e-9c15-06adf5a5b0ea service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-7550cbc6-653d-4a6b-9ce8-be65c912382f req-b6954768-d27f-418e-9c15-06adf5a5b0ea service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] No waiting events found dispatching network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:28 user nova-compute[74540]: WARNING nova.compute.manager [req-7550cbc6-653d-4a6b-9ce8-be65c912382f req-b6954768-d27f-418e-9c15-06adf5a5b0ea service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received unexpected event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 for instance with vm_state resized and task_state resize_reverting.
Nov 07 04:03:28 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:03:28 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Instance running successfully.
Nov 07 04:03:28 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] finish_revert_migration finished successfully. {{(pid=74540) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 07 04:03:28 user nova-compute[74540]: INFO nova.compute.manager [None req-f88e9f9c-e281-4868-ad51-729d3a4d3fe5 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating instance to original state: 'active'
Nov 07 04:03:28 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:03:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:33 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:03:33 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:03:33 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:03:33 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:03:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:33 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:03:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:03:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:03:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7762MB free_disk=25.187088012695312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6d43f26f-dfbb-4299-b875-f498979679d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance fab159b1-8768-4266-9a2f-3983628aeb86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a3cae7a7-223c-438e-8206-39e0f1683cb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6b84cdaa-6964-4e16-95b3-accb9086d871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:03:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a is timed out.
Nov 07 04:03:38 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Successfully detached device vdb from instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a from the live domain config.
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fhWLADTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:03:38 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[895c2373-af85-48a7-aee9-a37b8816e100]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:03:38 user nova-compute[74540]: No targets found.
Nov 07 04:03:38 user nova-compute[74540]: iSNS:
Nov 07 04:03:38 user nova-compute[74540]: No targets found.
Nov 07 04:03:38 user nova-compute[74540]: STATIC:
Nov 07 04:03:38 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d
Nov 07 04:03:38 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:03:38 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:03:38 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:03:38 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:03:38 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:03:38 user nova-compute[74540]: FIRMWARE:
Nov 07 04:03:38 user nova-compute[74540]: No targets found.
Nov 07 04:03:38 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:03:38 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:03:38 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e8cd6d-bc54-4981-ba87-3762a6933ded]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[68557e16-b3bb-4805-aea6-069500b23918]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:03:38 user nova-compute[74540]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:03:38 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d (non-flash)
Nov 07 04:03:38 user nova-compute[74540]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:03:38 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc1bb880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d'): ({'sdg'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Removing single pathed devices sdg {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4a00c5-3d9d-49c5-a7c1-b6ca8c720d57]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b44500f-25cc-4543-a248-37645968d555]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Flushing IO for device /dev/sdg {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d541cf42-7b91-46a1-8141-b9b207aadaaf]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e17c02-846b-4c98-892e-6d9d1140a13f]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] SCSI volumes sdg have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e079193-c2ad-4147-8da0-7041d0301568]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:03:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9d08e2-b0f8-4dfc-b47c-b94db362d03d]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d, portal: 172.16.0.220,3260]
Nov 07 04:03:39 user nova-compute[74540]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d, portal: 172.16.0.220,3260] successful.
Nov 07 04:03:39 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:196b6636-9efd-4905-b7a2-36a457b6818d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca427800-a109-4e47-9650-d82f3e72ef0b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] <== disconnect_volume: return (419ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:03:39 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:03:40 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 04:03:40 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:03:40 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:03:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:43 user nova-compute[74540]: DEBUG nova.objects.instance [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lazy-loading 'flavor' on Instance uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:03:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-385566c2-4d94-49e9-b056-011cb53f2632 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.195s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:03:44 user nova-compute[74540]: INFO nova.compute.claims [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Claim successful on node user
Nov 07 04:03:44 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG nova.network.neutron [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:03:44 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:03:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG nova.policy [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a7b1d7f7d954f9ab69427da7d64d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb763f6ff9544764b4b951b06ae0a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:03:44 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Creating image(s)
Nov 07 04:03:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "/opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "/opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "/opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk 1073741824" returned: 0 in 0.057s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG nova.network.neutron [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Successfully created port: eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.174s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Cannot resize image /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Ensure instance console log exists: /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:46 user nova-compute[74540]: DEBUG nova.network.neutron [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Successfully updated port: eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:03:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-cde2c4a1-cac8-4274-9f43-93a2acd75a39 req-cb5d8ca1-e1f8-44db-806d-ad3b090e9ea7 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Received event network-changed-eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-cde2c4a1-cac8-4274-9f43-93a2acd75a39 req-cb5d8ca1-e1f8-44db-806d-ad3b090e9ea7 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Refreshing instance network info cache due to event network-changed-eca23c6c-b0d5-4298-9b3f-ba330e542d3d. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:03:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-cde2c4a1-cac8-4274-9f43-93a2acd75a39 req-cb5d8ca1-e1f8-44db-806d-ad3b090e9ea7 service nova] Acquiring lock "refresh_cache-33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:03:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-cde2c4a1-cac8-4274-9f43-93a2acd75a39 req-cb5d8ca1-e1f8-44db-806d-ad3b090e9ea7 service nova] Acquired lock "refresh_cache-33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:03:46 user nova-compute[74540]: DEBUG nova.network.neutron [req-cde2c4a1-cac8-4274-9f43-93a2acd75a39 req-cb5d8ca1-e1f8-44db-806d-ad3b090e9ea7 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Refreshing network info cache for port eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:03:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "refresh_cache-33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:03:46 user nova-compute[74540]: DEBUG nova.network.neutron [req-cde2c4a1-cac8-4274-9f43-93a2acd75a39 req-cb5d8ca1-e1f8-44db-806d-ad3b090e9ea7 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.network.neutron [req-cde2c4a1-cac8-4274-9f43-93a2acd75a39 req-cb5d8ca1-e1f8-44db-806d-ad3b090e9ea7 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-cde2c4a1-cac8-4274-9f43-93a2acd75a39 req-cb5d8ca1-e1f8-44db-806d-ad3b090e9ea7 service nova] Releasing lock "refresh_cache-33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquired lock "refresh_cache-33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.network.neutron [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.network.neutron [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.network.neutron [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Updating instance_info_cache with network_info: [{"id": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "address": "fa:16:3e:cd:03:04", "network": {"id": "8fb8eb25-9c97-44be-a686-8a000dd45f55", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1770044310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb763f6ff9544764b4b951b06ae0a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca23c6c-b0", "ovs_interfaceid": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Releasing lock "refresh_cache-33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Instance network_info: |[{"id": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "address": "fa:16:3e:cd:03:04", "network": {"id": "8fb8eb25-9c97-44be-a686-8a000dd45f55", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1770044310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb763f6ff9544764b4b951b06ae0a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca23c6c-b0", "ovs_interfaceid": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Start _get_guest_xml network_info=[{"id": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "address": "fa:16:3e:cd:03:04", "network": {"id": "8fb8eb25-9c97-44be-a686-8a000dd45f55", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1770044310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb763f6ff9544764b4b951b06ae0a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca23c6c-b0", "ovs_interfaceid": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:03:47 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:03:47 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-760344290',display_name='tempest-DeleteServersTestJSON-server-760344290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-760344290',id=17,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb763f6ff9544764b4b951b06ae0a800',ramdisk_id='',reservation_id='r-agx25kyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-134629333',owner_user_name='tempest-DeleteServersTestJSON-134629333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:03:45Z,user_data=None,user_id='4a7b1d7f7d954f9ab69427da7d64d707',uuid=33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "address": "fa:16:3e:cd:03:04", "network": {"id": "8fb8eb25-9c97-44be-a686-8a000dd45f55", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1770044310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb763f6ff9544764b4b951b06ae0a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca23c6c-b0", "ovs_interfaceid": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Converting VIF {"id": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "address": "fa:16:3e:cd:03:04", "network": {"id": "8fb8eb25-9c97-44be-a686-8a000dd45f55", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1770044310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb763f6ff9544764b4b951b06ae0a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca23c6c-b0", "ovs_interfaceid": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:03:04,bridge_name='br-int',has_traffic_filtering=True,id=eca23c6c-b0d5-4298-9b3f-ba330e542d3d,network=Network(8fb8eb25-9c97-44be-a686-8a000dd45f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca23c6c-b0') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.objects.instance [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lazy-loading 'pci_devices' on Instance uuid 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:03:47 user nova-compute[74540]:   <uuid>33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d</uuid>
Nov 07 04:03:47 user nova-compute[74540]:   <name>instance-00000011</name>
Nov 07 04:03:47 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:03:47 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:03:47 user nova-compute[74540]:   <metadata>
Nov 07 04:03:47 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:03:47 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:03:47 user nova-compute[74540]:       <nova:name>tempest-DeleteServersTestJSON-server-760344290</nova:name>
Nov 07 04:03:47 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:03:47</nova:creationTime>
Nov 07 04:03:47 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:03:47 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:03:47 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:03:47 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:03:47 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:03:47 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:03:47 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:03:47 user nova-compute[74540]:       <nova:owner>
Nov 07 04:03:47 user nova-compute[74540]:         <nova:user uuid="4a7b1d7f7d954f9ab69427da7d64d707">tempest-DeleteServersTestJSON-134629333-project-member</nova:user>
Nov 07 04:03:47 user nova-compute[74540]:         <nova:project uuid="bb763f6ff9544764b4b951b06ae0a800">tempest-DeleteServersTestJSON-134629333</nova:project>
Nov 07 04:03:47 user nova-compute[74540]:       </nova:owner>
Nov 07 04:03:47 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:03:47 user nova-compute[74540]:       <nova:ports>
Nov 07 04:03:47 user nova-compute[74540]:         <nova:port uuid="eca23c6c-b0d5-4298-9b3f-ba330e542d3d">
Nov 07 04:03:47 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:03:47 user nova-compute[74540]:         </nova:port>
Nov 07 04:03:47 user nova-compute[74540]:       </nova:ports>
Nov 07 04:03:47 user nova-compute[74540]:     </nova:instance>
Nov 07 04:03:47 user nova-compute[74540]:   </metadata>
Nov 07 04:03:47 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:03:47 user nova-compute[74540]:     <system>
Nov 07 04:03:47 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:03:47 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:03:47 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:03:47 user nova-compute[74540]:       <entry name="serial">33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d</entry>
Nov 07 04:03:47 user nova-compute[74540]:       <entry name="uuid">33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d</entry>
Nov 07 04:03:47 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:03:47 user nova-compute[74540]:     </system>
Nov 07 04:03:47 user nova-compute[74540]:   </sysinfo>
Nov 07 04:03:47 user nova-compute[74540]:   <os>
Nov 07 04:03:47 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:03:47 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:03:47 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:03:47 user nova-compute[74540]:   </os>
Nov 07 04:03:47 user nova-compute[74540]:   <features>
Nov 07 04:03:47 user nova-compute[74540]:     <acpi/>
Nov 07 04:03:47 user nova-compute[74540]:     <apic/>
Nov 07 04:03:47 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:03:47 user nova-compute[74540]:   </features>
Nov 07 04:03:47 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:03:47 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:03:47 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:03:47 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:03:47 user nova-compute[74540]:   </clock>
Nov 07 04:03:47 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:03:47 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:03:47 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:03:47 user nova-compute[74540]:   </cpu>
Nov 07 04:03:47 user nova-compute[74540]:   <devices>
Nov 07 04:03:47 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:03:47 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:03:47 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk"/>
Nov 07 04:03:47 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:03:47 user nova-compute[74540]:     </disk>
Nov 07 04:03:47 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:03:47 user nova-compute[74540]:       <mac address="fa:16:3e:cd:03:04"/>
Nov 07 04:03:47 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:03:47 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:03:47 user nova-compute[74540]:       <target dev="tapeca23c6c-b0"/>
Nov 07 04:03:47 user nova-compute[74540]:     </interface>
Nov 07 04:03:47 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:03:47 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/console.log" append="off"/>
Nov 07 04:03:47 user nova-compute[74540]:     </serial>
Nov 07 04:03:47 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:03:47 user nova-compute[74540]:     <video>
Nov 07 04:03:47 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:03:47 user nova-compute[74540]:     </video>
Nov 07 04:03:47 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:03:47 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:03:47 user nova-compute[74540]:     </rng>
Nov 07 04:03:47 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:03:47 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:03:47 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:03:47 user nova-compute[74540]:     </memballoon>
Nov 07 04:03:47 user nova-compute[74540]:   </devices>
Nov 07 04:03:47 user nova-compute[74540]: </domain>
Nov 07 04:03:47 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-760344290',display_name='tempest-DeleteServersTestJSON-server-760344290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-760344290',id=17,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb763f6ff9544764b4b951b06ae0a800',ramdisk_id='',reservation_id='r-agx25kyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-134629333',owner_user_name='tempest-DeleteServersTestJSON-134629333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:03:45Z,user_data=None,user_id='4a7b1d7f7d954f9ab69427da7d64d707',uuid=33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "address": "fa:16:3e:cd:03:04", "network": {"id": "8fb8eb25-9c97-44be-a686-8a000dd45f55", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1770044310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb763f6ff9544764b4b951b06ae0a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca23c6c-b0", "ovs_interfaceid": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Converting VIF {"id": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "address": "fa:16:3e:cd:03:04", "network": {"id": "8fb8eb25-9c97-44be-a686-8a000dd45f55", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1770044310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb763f6ff9544764b4b951b06ae0a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca23c6c-b0", "ovs_interfaceid": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:03:04,bridge_name='br-int',has_traffic_filtering=True,id=eca23c6c-b0d5-4298-9b3f-ba330e542d3d,network=Network(8fb8eb25-9c97-44be-a686-8a000dd45f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca23c6c-b0') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG os_vif [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:03:04,bridge_name='br-int',has_traffic_filtering=True,id=eca23c6c-b0d5-4298-9b3f-ba330e542d3d,network=Network(8fb8eb25-9c97-44be-a686-8a000dd45f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca23c6c-b0') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5eef912a-375c-5591-b221-f51a0d4d9086', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeca23c6c-b0, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeca23c6c-b0, col_values=(('qos', UUID('ff27b376-dd55-40bf-b80a-efb19b67f5eb')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeca23c6c-b0, col_values=(('external_ids', {'iface-id': 'eca23c6c-b0d5-4298-9b3f-ba330e542d3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:03:04', 'vm-uuid': '33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:03:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:47 user nova-compute[74540]: INFO os_vif [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:03:04,bridge_name='br-int',has_traffic_filtering=True,id=eca23c6c-b0d5-4298-9b3f-ba330e542d3d,network=Network(8fb8eb25-9c97-44be-a686-8a000dd45f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca23c6c-b0')
Nov 07 04:03:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:03:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] No VIF found with MAC fa:16:3e:cd:03:04, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:03:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-26876e16-23ce-424a-9d0d-4c2eed6b5b37 req-1cefe429-b5ba-4c1e-b786-6abbdfc05b91 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Received event network-vif-plugged-eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-26876e16-23ce-424a-9d0d-4c2eed6b5b37 req-1cefe429-b5ba-4c1e-b786-6abbdfc05b91 service nova] Acquiring lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-26876e16-23ce-424a-9d0d-4c2eed6b5b37 req-1cefe429-b5ba-4c1e-b786-6abbdfc05b91 service nova] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-26876e16-23ce-424a-9d0d-4c2eed6b5b37 req-1cefe429-b5ba-4c1e-b786-6abbdfc05b91 service nova] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-26876e16-23ce-424a-9d0d-4c2eed6b5b37 req-1cefe429-b5ba-4c1e-b786-6abbdfc05b91 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] No waiting events found dispatching network-vif-plugged-eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:49 user nova-compute[74540]: WARNING nova.compute.manager [req-26876e16-23ce-424a-9d0d-4c2eed6b5b37 req-1cefe429-b5ba-4c1e-b786-6abbdfc05b91 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Received unexpected event network-vif-plugged-eca23c6c-b0d5-4298-9b3f-ba330e542d3d for instance with vm_state building and task_state spawning.
Nov 07 04:03:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:03:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Instance spawned successfully.
Nov 07 04:03:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:03:51 user nova-compute[74540]: INFO nova.compute.manager [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 07 04:03:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG nova.compute.manager [req-570ec357-35b9-44a0-9ee6-5d1d0bc36b79 req-80008680-f014-4824-b603-3dab09279722 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Received event network-vif-plugged-eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-570ec357-35b9-44a0-9ee6-5d1d0bc36b79 req-80008680-f014-4824-b603-3dab09279722 service nova] Acquiring lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-570ec357-35b9-44a0-9ee6-5d1d0bc36b79 req-80008680-f014-4824-b603-3dab09279722 service nova] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-570ec357-35b9-44a0-9ee6-5d1d0bc36b79 req-80008680-f014-4824-b603-3dab09279722 service nova] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:51 user nova-compute[74540]: DEBUG nova.compute.manager [req-570ec357-35b9-44a0-9ee6-5d1d0bc36b79 req-80008680-f014-4824-b603-3dab09279722 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] No waiting events found dispatching network-vif-plugged-eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:03:51 user nova-compute[74540]: WARNING nova.compute.manager [req-570ec357-35b9-44a0-9ee6-5d1d0bc36b79 req-80008680-f014-4824-b603-3dab09279722 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Received unexpected event network-vif-plugged-eca23c6c-b0d5-4298-9b3f-ba330e542d3d for instance with vm_state building and task_state spawning.
Nov 07 04:03:51 user nova-compute[74540]: INFO nova.compute.manager [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Took 7.59 seconds to build instance.
Nov 07 04:03:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a4079d1a-a747-4e9a-9cc1-371ab812280c tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.795s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:03:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:03:55 user nova-compute[74540]: INFO nova.compute.claims [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Claim successful on node user
Nov 07 04:03:55 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:03:55 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:03:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:03:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:03:55 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:03:55 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:03:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG nova.policy [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '791771e33e0645d6b97cef52f84d8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513e7858a1b34aa2bd5f363696b38f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:03:56 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Creating image(s)
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "/opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "/opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "/opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.231s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk 1073741824" returned: 0 in 0.054s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.239s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:03:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Successfully created port: 134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Cannot resize image /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Ensure instance console log exists: /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Successfully updated port: 134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquired lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-31fab40e-c1f7-4d48-be0f-fe6413aee7a6 req-72be00fd-54e1-4157-9c9e-e80ab01b9ee1 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-changed-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-31fab40e-c1f7-4d48-be0f-fe6413aee7a6 req-72be00fd-54e1-4157-9c9e-e80ab01b9ee1 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Refreshing instance network info cache due to event network-changed-134a19cd-7f72-44e1-82c0-5ffab04d98b6. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-31fab40e-c1f7-4d48-be0f-fe6413aee7a6 req-72be00fd-54e1-4157-9c9e-e80ab01b9ee1 service nova] Acquiring lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:03:57 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updating instance_info_cache with network_info: [{"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Releasing lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance network_info: |[{"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-31fab40e-c1f7-4d48-be0f-fe6413aee7a6 req-72be00fd-54e1-4157-9c9e-e80ab01b9ee1 service nova] Acquired lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.network.neutron [req-31fab40e-c1f7-4d48-be0f-fe6413aee7a6 req-72be00fd-54e1-4157-9c9e-e80ab01b9ee1 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Refreshing network info cache for port 134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Start _get_guest_xml network_info=[{"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:03:58 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:03:58 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911941987',display_name='tempest-AttachVolumeTestJSON-server-1911941987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911941987',id=18,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZc0H8u9Sjs7UCPrYgQ/YYzLFW938ISChSSmxmxSC0YJVGNn+t+64OY9nQmYmr4BRKTp4XCwtT9CfL/C0bBD3MbQluNfqx9UtboWoTJuQ/vtZlZuy9FmbFmNS0Ski8AxQ==',key_name='tempest-keypair-1685201050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513e7858a1b34aa2bd5f363696b38f0a',ramdisk_id='',reservation_id='r-3y9w8i3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-540287196',owner_user_name='tempest-AttachVolumeTestJSON-540287196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='791771e33e0645d6b97cef52f84d8b9c',uuid=80624b0b-4c6b-4d6f-9d31-2f7c81e39c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converting VIF {"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.objects.instance [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'pci_devices' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:03:58 user nova-compute[74540]:   <uuid>80624b0b-4c6b-4d6f-9d31-2f7c81e39c79</uuid>
Nov 07 04:03:58 user nova-compute[74540]:   <name>instance-00000012</name>
Nov 07 04:03:58 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:03:58 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:03:58 user nova-compute[74540]:   <metadata>
Nov 07 04:03:58 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:03:58 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:03:58 user nova-compute[74540]:       <nova:name>tempest-AttachVolumeTestJSON-server-1911941987</nova:name>
Nov 07 04:03:58 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:03:58</nova:creationTime>
Nov 07 04:03:58 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:03:58 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:03:58 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:03:58 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:03:58 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:03:58 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:03:58 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:03:58 user nova-compute[74540]:       <nova:owner>
Nov 07 04:03:58 user nova-compute[74540]:         <nova:user uuid="791771e33e0645d6b97cef52f84d8b9c">tempest-AttachVolumeTestJSON-540287196-project-member</nova:user>
Nov 07 04:03:58 user nova-compute[74540]:         <nova:project uuid="513e7858a1b34aa2bd5f363696b38f0a">tempest-AttachVolumeTestJSON-540287196</nova:project>
Nov 07 04:03:58 user nova-compute[74540]:       </nova:owner>
Nov 07 04:03:58 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:03:58 user nova-compute[74540]:       <nova:ports>
Nov 07 04:03:58 user nova-compute[74540]:         <nova:port uuid="134a19cd-7f72-44e1-82c0-5ffab04d98b6">
Nov 07 04:03:58 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 04:03:58 user nova-compute[74540]:         </nova:port>
Nov 07 04:03:58 user nova-compute[74540]:       </nova:ports>
Nov 07 04:03:58 user nova-compute[74540]:     </nova:instance>
Nov 07 04:03:58 user nova-compute[74540]:   </metadata>
Nov 07 04:03:58 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:03:58 user nova-compute[74540]:     <system>
Nov 07 04:03:58 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:03:58 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:03:58 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:03:58 user nova-compute[74540]:       <entry name="serial">80624b0b-4c6b-4d6f-9d31-2f7c81e39c79</entry>
Nov 07 04:03:58 user nova-compute[74540]:       <entry name="uuid">80624b0b-4c6b-4d6f-9d31-2f7c81e39c79</entry>
Nov 07 04:03:58 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:03:58 user nova-compute[74540]:     </system>
Nov 07 04:03:58 user nova-compute[74540]:   </sysinfo>
Nov 07 04:03:58 user nova-compute[74540]:   <os>
Nov 07 04:03:58 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:03:58 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:03:58 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:03:58 user nova-compute[74540]:   </os>
Nov 07 04:03:58 user nova-compute[74540]:   <features>
Nov 07 04:03:58 user nova-compute[74540]:     <acpi/>
Nov 07 04:03:58 user nova-compute[74540]:     <apic/>
Nov 07 04:03:58 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:03:58 user nova-compute[74540]:   </features>
Nov 07 04:03:58 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:03:58 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:03:58 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:03:58 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:03:58 user nova-compute[74540]:   </clock>
Nov 07 04:03:58 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:03:58 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:03:58 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:03:58 user nova-compute[74540]:   </cpu>
Nov 07 04:03:58 user nova-compute[74540]:   <devices>
Nov 07 04:03:58 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:03:58 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:03:58 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk"/>
Nov 07 04:03:58 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:03:58 user nova-compute[74540]:     </disk>
Nov 07 04:03:58 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:03:58 user nova-compute[74540]:       <mac address="fa:16:3e:53:d9:ef"/>
Nov 07 04:03:58 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:03:58 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:03:58 user nova-compute[74540]:       <target dev="tap134a19cd-7f"/>
Nov 07 04:03:58 user nova-compute[74540]:     </interface>
Nov 07 04:03:58 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:03:58 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/console.log" append="off"/>
Nov 07 04:03:58 user nova-compute[74540]:     </serial>
Nov 07 04:03:58 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:03:58 user nova-compute[74540]:     <video>
Nov 07 04:03:58 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:03:58 user nova-compute[74540]:     </video>
Nov 07 04:03:58 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:03:58 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:03:58 user nova-compute[74540]:     </rng>
Nov 07 04:03:58 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:03:58 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:03:58 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:03:58 user nova-compute[74540]:     </memballoon>
Nov 07 04:03:58 user nova-compute[74540]:   </devices>
Nov 07 04:03:58 user nova-compute[74540]: </domain>
Nov 07 04:03:58 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911941987',display_name='tempest-AttachVolumeTestJSON-server-1911941987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911941987',id=18,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZc0H8u9Sjs7UCPrYgQ/YYzLFW938ISChSSmxmxSC0YJVGNn+t+64OY9nQmYmr4BRKTp4XCwtT9CfL/C0bBD3MbQluNfqx9UtboWoTJuQ/vtZlZuy9FmbFmNS0Ski8AxQ==',key_name='tempest-keypair-1685201050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513e7858a1b34aa2bd5f363696b38f0a',ramdisk_id='',reservation_id='r-3y9w8i3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-540287196',owner_user_name='tempest-AttachVolumeTestJSON-540287196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='791771e33e0645d6b97cef52f84d8b9c',uuid=80624b0b-4c6b-4d6f-9d31-2f7c81e39c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converting VIF {"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG os_vif [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcc936cd-f2bc-5060-88af-a79f2136c4ca', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap134a19cd-7f, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap134a19cd-7f, col_values=(('qos', UUID('c1962f8a-0dec-46de-b76e-18120ea8e9b3')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap134a19cd-7f, col_values=(('external_ids', {'iface-id': '134a19cd-7f72-44e1-82c0-5ffab04d98b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:d9:ef', 'vm-uuid': '80624b0b-4c6b-4d6f-9d31-2f7c81e39c79'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:03:58 user nova-compute[74540]: INFO os_vif [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f')
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No VIF found with MAC fa:16:3e:53:d9:ef, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.network.neutron [req-31fab40e-c1f7-4d48-be0f-fe6413aee7a6 req-72be00fd-54e1-4157-9c9e-e80ab01b9ee1 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updated VIF entry in instance network info cache for port 134a19cd-7f72-44e1-82c0-5ffab04d98b6. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG nova.network.neutron [req-31fab40e-c1f7-4d48-be0f-fe6413aee7a6 req-72be00fd-54e1-4157-9c9e-e80ab01b9ee1 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updating instance_info_cache with network_info: [{"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:03:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-31fab40e-c1f7-4d48-be0f-fe6413aee7a6 req-72be00fd-54e1-4157-9c9e-e80ab01b9ee1 service nova] Releasing lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:03:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "45cf1e18-0792-451b-8022-000ba35ad605" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:59 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:03:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:03:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:03:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:03:59 user nova-compute[74540]: INFO nova.compute.claims [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Claim successful on node user
Nov 07 04:04:00 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG nova.network.neutron [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:04:00 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:04:00 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG nova.policy [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3079ba3a84ea4b4bb4a3e576ab4133ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620cefdadcec49d6a696aa7db8cef2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-9c25113c-3811-44b9-9844-926d3394a5c7 req-a29b13e2-9e43-49d5-a5dd-3da8cdce33c0 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9c25113c-3811-44b9-9844-926d3394a5c7 req-a29b13e2-9e43-49d5-a5dd-3da8cdce33c0 service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9c25113c-3811-44b9-9844-926d3394a5c7 req-a29b13e2-9e43-49d5-a5dd-3da8cdce33c0 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9c25113c-3811-44b9-9844-926d3394a5c7 req-a29b13e2-9e43-49d5-a5dd-3da8cdce33c0 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-9c25113c-3811-44b9-9844-926d3394a5c7 req-a29b13e2-9e43-49d5-a5dd-3da8cdce33c0 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:00 user nova-compute[74540]: WARNING nova.compute.manager [req-9c25113c-3811-44b9-9844-926d3394a5c7 req-a29b13e2-9e43-49d5-a5dd-3da8cdce33c0 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state building and task_state spawning.
Nov 07 04:04:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:04:01 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Creating image(s)
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "/opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "/opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "/opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk 1073741824" returned: 0 in 0.066s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Cannot resize image /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Ensure instance console log exists: /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:01 user nova-compute[74540]: DEBUG nova.network.neutron [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Successfully created port: 4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.network.neutron [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Successfully updated port: 4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "refresh_cache-45cf1e18-0792-451b-8022-000ba35ad605" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquired lock "refresh_cache-45cf1e18-0792-451b-8022-000ba35ad605" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.network.neutron [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:04:02 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance spawned successfully.
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.network.neutron [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:04:02 user nova-compute[74540]: INFO nova.compute.manager [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:02 user nova-compute[74540]: WARNING nova.compute.manager [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state building and task_state spawning.
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-changed-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Refreshing instance network info cache due to event network-changed-4a999f3e-8cfa-4a58-871d-76baa2cec648. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:04:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] Acquiring lock "refresh_cache-45cf1e18-0792-451b-8022-000ba35ad605" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:04:02 user nova-compute[74540]: INFO nova.compute.manager [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Took 7.50 seconds to build instance.
Nov 07 04:04:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0c9dbe8b-45df-41f4-87e7-498b73407eaf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.645s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.network.neutron [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Updating instance_info_cache with network_info: [{"id": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "address": "fa:16:3e:a5:ae:91", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a999f3e-8c", "ovs_interfaceid": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Releasing lock "refresh_cache-45cf1e18-0792-451b-8022-000ba35ad605" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Instance network_info: |[{"id": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "address": "fa:16:3e:a5:ae:91", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a999f3e-8c", "ovs_interfaceid": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] Acquired lock "refresh_cache-45cf1e18-0792-451b-8022-000ba35ad605" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.network.neutron [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Refreshing network info cache for port 4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Start _get_guest_xml network_info=[{"id": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "address": "fa:16:3e:a5:ae:91", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a999f3e-8c", "ovs_interfaceid": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:04:03 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:04:03 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1013489216',display_name='tempest-AttachVolumeNegativeTest-server-1013489216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1013489216',id=19,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/MCElulRiJ/9B/40jlsiWJf8Jcy8+irukKGC/rt0ohtiJVrIBxdnEYukZsUf7EsICgw9/O8o/mk+RI5nPHKVIbDfPP6cJDfxyTMZ38YWZ5RGkulgJrymVrlh/cqn2WaA==',key_name='tempest-keypair-1108126652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='620cefdadcec49d6a696aa7db8cef2d1',ramdisk_id='',reservation_id='r-1zrlj03s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-306463361',owner_user_name='tempest-AttachVolumeNegativeTest-306463361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3079ba3a84ea4b4bb4a3e576ab4133ae',uuid=45cf1e18-0792-451b-8022-000ba35ad605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "address": "fa:16:3e:a5:ae:91", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a999f3e-8c", "ovs_interfaceid": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converting VIF {"id": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "address": "fa:16:3e:a5:ae:91", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a999f3e-8c", "ovs_interfaceid": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ae:91,bridge_name='br-int',has_traffic_filtering=True,id=4a999f3e-8cfa-4a58-871d-76baa2cec648,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a999f3e-8c') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.objects.instance [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'pci_devices' on Instance uuid 45cf1e18-0792-451b-8022-000ba35ad605 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:04:03 user nova-compute[74540]:   <uuid>45cf1e18-0792-451b-8022-000ba35ad605</uuid>
Nov 07 04:04:03 user nova-compute[74540]:   <name>instance-00000013</name>
Nov 07 04:04:03 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:04:03 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:04:03 user nova-compute[74540]:   <metadata>
Nov 07 04:04:03 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:04:03 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:04:03 user nova-compute[74540]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1013489216</nova:name>
Nov 07 04:04:03 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:04:03</nova:creationTime>
Nov 07 04:04:03 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:04:03 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:04:03 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:04:03 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:04:03 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:04:03 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:04:03 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:04:03 user nova-compute[74540]:       <nova:owner>
Nov 07 04:04:03 user nova-compute[74540]:         <nova:user uuid="3079ba3a84ea4b4bb4a3e576ab4133ae">tempest-AttachVolumeNegativeTest-306463361-project-member</nova:user>
Nov 07 04:04:03 user nova-compute[74540]:         <nova:project uuid="620cefdadcec49d6a696aa7db8cef2d1">tempest-AttachVolumeNegativeTest-306463361</nova:project>
Nov 07 04:04:03 user nova-compute[74540]:       </nova:owner>
Nov 07 04:04:03 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:04:03 user nova-compute[74540]:       <nova:ports>
Nov 07 04:04:03 user nova-compute[74540]:         <nova:port uuid="4a999f3e-8cfa-4a58-871d-76baa2cec648">
Nov 07 04:04:03 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 04:04:03 user nova-compute[74540]:         </nova:port>
Nov 07 04:04:03 user nova-compute[74540]:       </nova:ports>
Nov 07 04:04:03 user nova-compute[74540]:     </nova:instance>
Nov 07 04:04:03 user nova-compute[74540]:   </metadata>
Nov 07 04:04:03 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:04:03 user nova-compute[74540]:     <system>
Nov 07 04:04:03 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:04:03 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:04:03 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:04:03 user nova-compute[74540]:       <entry name="serial">45cf1e18-0792-451b-8022-000ba35ad605</entry>
Nov 07 04:04:03 user nova-compute[74540]:       <entry name="uuid">45cf1e18-0792-451b-8022-000ba35ad605</entry>
Nov 07 04:04:03 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:04:03 user nova-compute[74540]:     </system>
Nov 07 04:04:03 user nova-compute[74540]:   </sysinfo>
Nov 07 04:04:03 user nova-compute[74540]:   <os>
Nov 07 04:04:03 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:04:03 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:04:03 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:04:03 user nova-compute[74540]:   </os>
Nov 07 04:04:03 user nova-compute[74540]:   <features>
Nov 07 04:04:03 user nova-compute[74540]:     <acpi/>
Nov 07 04:04:03 user nova-compute[74540]:     <apic/>
Nov 07 04:04:03 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:04:03 user nova-compute[74540]:   </features>
Nov 07 04:04:03 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:04:03 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:04:03 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:04:03 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:04:03 user nova-compute[74540]:   </clock>
Nov 07 04:04:03 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:04:03 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:04:03 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:04:03 user nova-compute[74540]:   </cpu>
Nov 07 04:04:03 user nova-compute[74540]:   <devices>
Nov 07 04:04:03 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:04:03 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:04:03 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk"/>
Nov 07 04:04:03 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:04:03 user nova-compute[74540]:     </disk>
Nov 07 04:04:03 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:04:03 user nova-compute[74540]:       <mac address="fa:16:3e:a5:ae:91"/>
Nov 07 04:04:03 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:04:03 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:04:03 user nova-compute[74540]:       <target dev="tap4a999f3e-8c"/>
Nov 07 04:04:03 user nova-compute[74540]:     </interface>
Nov 07 04:04:03 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:04:03 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/console.log" append="off"/>
Nov 07 04:04:03 user nova-compute[74540]:     </serial>
Nov 07 04:04:03 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:04:03 user nova-compute[74540]:     <video>
Nov 07 04:04:03 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:04:03 user nova-compute[74540]:     </video>
Nov 07 04:04:03 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:04:03 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:04:03 user nova-compute[74540]:     </rng>
Nov 07 04:04:03 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:04:03 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:04:03 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:04:03 user nova-compute[74540]:     </memballoon>
Nov 07 04:04:03 user nova-compute[74540]:   </devices>
Nov 07 04:04:03 user nova-compute[74540]: </domain>
Nov 07 04:04:03 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1013489216',display_name='tempest-AttachVolumeNegativeTest-server-1013489216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1013489216',id=19,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/MCElulRiJ/9B/40jlsiWJf8Jcy8+irukKGC/rt0ohtiJVrIBxdnEYukZsUf7EsICgw9/O8o/mk+RI5nPHKVIbDfPP6cJDfxyTMZ38YWZ5RGkulgJrymVrlh/cqn2WaA==',key_name='tempest-keypair-1108126652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='620cefdadcec49d6a696aa7db8cef2d1',ramdisk_id='',reservation_id='r-1zrlj03s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-306463361',owner_user_name='tempest-AttachVolumeNegativeTest-306463361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3079ba3a84ea4b4bb4a3e576ab4133ae',uuid=45cf1e18-0792-451b-8022-000ba35ad605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "address": "fa:16:3e:a5:ae:91", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a999f3e-8c", "ovs_interfaceid": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converting VIF {"id": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "address": "fa:16:3e:a5:ae:91", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a999f3e-8c", "ovs_interfaceid": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ae:91,bridge_name='br-int',has_traffic_filtering=True,id=4a999f3e-8cfa-4a58-871d-76baa2cec648,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a999f3e-8c') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG os_vif [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ae:91,bridge_name='br-int',has_traffic_filtering=True,id=4a999f3e-8cfa-4a58-871d-76baa2cec648,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a999f3e-8c') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bac3eab-6866-54e3-a210-4981bd0ac996', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a999f3e-8c, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a999f3e-8c, col_values=(('qos', UUID('04ec5692-8a7c-4ab4-bb56-1d7ca6b53eb1')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a999f3e-8c, col_values=(('external_ids', {'iface-id': '4a999f3e-8cfa-4a58-871d-76baa2cec648', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:ae:91', 'vm-uuid': '45cf1e18-0792-451b-8022-000ba35ad605'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:03 user nova-compute[74540]: INFO os_vif [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:ae:91,bridge_name='br-int',has_traffic_filtering=True,id=4a999f3e-8cfa-4a58-871d-76baa2cec648,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a999f3e-8c')
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No VIF found with MAC fa:16:3e:a5:ae:91, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.network.neutron [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Updated VIF entry in instance network info cache for port 4a999f3e-8cfa-4a58-871d-76baa2cec648. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG nova.network.neutron [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Updating instance_info_cache with network_info: [{"id": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "address": "fa:16:3e:a5:ae:91", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a999f3e-8c", "ovs_interfaceid": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:04:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7c55e367-1645-4ee2-b8c4-4a6845cfaf61 req-83592f0a-e623-4721-a52a-ebf23b56c64f service nova] Releasing lock "refresh_cache-45cf1e18-0792-451b-8022-000ba35ad605" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:04:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-cb198766-4d57-4a11-8d57-63a756944264 req-51a82d6d-1d9c-489d-88be-19a6d820109c service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-cb198766-4d57-4a11-8d57-63a756944264 req-51a82d6d-1d9c-489d-88be-19a6d820109c service nova] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-cb198766-4d57-4a11-8d57-63a756944264 req-51a82d6d-1d9c-489d-88be-19a6d820109c service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-cb198766-4d57-4a11-8d57-63a756944264 req-51a82d6d-1d9c-489d-88be-19a6d820109c service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-cb198766-4d57-4a11-8d57-63a756944264 req-51a82d6d-1d9c-489d-88be-19a6d820109c service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] No waiting events found dispatching network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:05 user nova-compute[74540]: WARNING nova.compute.manager [req-cb198766-4d57-4a11-8d57-63a756944264 req-51a82d6d-1d9c-489d-88be-19a6d820109c service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received unexpected event network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 for instance with vm_state building and task_state spawning.
Nov 07 04:04:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-29490d04-ae53-4c1e-9154-f99fea5bd966 req-45a2614d-fc27-4740-9b1a-8c82e3979fe9 service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-29490d04-ae53-4c1e-9154-f99fea5bd966 req-45a2614d-fc27-4740-9b1a-8c82e3979fe9 service nova] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-29490d04-ae53-4c1e-9154-f99fea5bd966 req-45a2614d-fc27-4740-9b1a-8c82e3979fe9 service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-29490d04-ae53-4c1e-9154-f99fea5bd966 req-45a2614d-fc27-4740-9b1a-8c82e3979fe9 service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-29490d04-ae53-4c1e-9154-f99fea5bd966 req-45a2614d-fc27-4740-9b1a-8c82e3979fe9 service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] No waiting events found dispatching network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:07 user nova-compute[74540]: WARNING nova.compute.manager [req-29490d04-ae53-4c1e-9154-f99fea5bd966 req-45a2614d-fc27-4740-9b1a-8c82e3979fe9 service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received unexpected event network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 for instance with vm_state building and task_state spawning.
Nov 07 04:04:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:04:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:04:07 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Instance spawned successfully.
Nov 07 04:04:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:04:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:04:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:04:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:04:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:04:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:04:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:04:07 user nova-compute[74540]: INFO nova.compute.manager [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Took 6.37 seconds to spawn the instance on the hypervisor.
Nov 07 04:04:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:04:07 user nova-compute[74540]: INFO nova.compute.manager [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Took 7.91 seconds to build instance.
Nov 07 04:04:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6547ee5a-8d32-4b79-8a4b-5c52865e223a tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "45cf1e18-0792-451b-8022-000ba35ad605" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.016s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "6d43f26f-dfbb-4299-b875-f498979679d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:08 user nova-compute[74540]: INFO nova.compute.manager [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Terminating instance
Nov 07 04:04:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:04:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:09 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Instance destroyed successfully.
Nov 07 04:04:09 user nova-compute[74540]: DEBUG nova.objects.instance [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lazy-loading 'resources' on Instance uuid 6d43f26f-dfbb-4299-b875-f498979679d9 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1528697524',display_name='tempest-VolumesAdminNegativeTest-server-1528697524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1528697524',id=6,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkBJnzeV/EgUJz1TOfRnbqbs/0u7gpVXu0e6c0J7Uzcu4LFs2w0abfAE6U05a165ZTzRMtQPNqMalXGNGUhz227T7ZBYa+MgXLBEKkhmBWe0A8l97utGO9HnRnfm3XtoQ==',key_name='tempest-keypair-1821227745',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:57:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22541886dbac4b43a412699358e12f25',ramdisk_id='',reservation_id='r-ss4ea0m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1758788930',owner_user_name='tempest-VolumesAdminNegativeTest-1758788930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:57:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72436e7806974d159635dc3d86785dff',uuid=6d43f26f-dfbb-4299-b875-f498979679d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "address": "fa:16:3e:48:2e:c5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c295a9-0e", "ovs_interfaceid": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Converting VIF {"id": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "address": "fa:16:3e:48:2e:c5", "network": {"id": "ad99d772-7d76-4d5e-93f2-5b51bd1700c4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-245172498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22541886dbac4b43a412699358e12f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c295a9-0e", "ovs_interfaceid": "93c295a9-0e82-4a04-9eab-7dea70ad507c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:2e:c5,bridge_name='br-int',has_traffic_filtering=True,id=93c295a9-0e82-4a04-9eab-7dea70ad507c,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c295a9-0e') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG os_vif [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:2e:c5,bridge_name='br-int',has_traffic_filtering=True,id=93c295a9-0e82-4a04-9eab-7dea70ad507c,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c295a9-0e') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93c295a9-0e, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-6cbcf45b-f3e2-44e8-bab2-2e7685eb44d5 req-da944123-c9a3-42d7-9c7e-5ffcbaa2f4bb service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received event network-vif-unplugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6cbcf45b-f3e2-44e8-bab2-2e7685eb44d5 req-da944123-c9a3-42d7-9c7e-5ffcbaa2f4bb service nova] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6cbcf45b-f3e2-44e8-bab2-2e7685eb44d5 req-da944123-c9a3-42d7-9c7e-5ffcbaa2f4bb service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6cbcf45b-f3e2-44e8-bab2-2e7685eb44d5 req-da944123-c9a3-42d7-9c7e-5ffcbaa2f4bb service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-6cbcf45b-f3e2-44e8-bab2-2e7685eb44d5 req-da944123-c9a3-42d7-9c7e-5ffcbaa2f4bb service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] No waiting events found dispatching network-vif-unplugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-6cbcf45b-f3e2-44e8-bab2-2e7685eb44d5 req-da944123-c9a3-42d7-9c7e-5ffcbaa2f4bb service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received event network-vif-unplugged-93c295a9-0e82-4a04-9eab-7dea70ad507c for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-6cbcf45b-f3e2-44e8-bab2-2e7685eb44d5 req-da944123-c9a3-42d7-9c7e-5ffcbaa2f4bb service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received event network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6cbcf45b-f3e2-44e8-bab2-2e7685eb44d5 req-da944123-c9a3-42d7-9c7e-5ffcbaa2f4bb service nova] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6cbcf45b-f3e2-44e8-bab2-2e7685eb44d5 req-da944123-c9a3-42d7-9c7e-5ffcbaa2f4bb service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6cbcf45b-f3e2-44e8-bab2-2e7685eb44d5 req-da944123-c9a3-42d7-9c7e-5ffcbaa2f4bb service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-6cbcf45b-f3e2-44e8-bab2-2e7685eb44d5 req-da944123-c9a3-42d7-9c7e-5ffcbaa2f4bb service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] No waiting events found dispatching network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:09 user nova-compute[74540]: WARNING nova.compute.manager [req-6cbcf45b-f3e2-44e8-bab2-2e7685eb44d5 req-da944123-c9a3-42d7-9c7e-5ffcbaa2f4bb service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received unexpected event network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c for instance with vm_state active and task_state deleting.
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df6ceb5c-03e0-4d54-a74d-ea9e1c7326ff) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:04:09 user nova-compute[74540]: INFO os_vif [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:2e:c5,bridge_name='br-int',has_traffic_filtering=True,id=93c295a9-0e82-4a04-9eab-7dea70ad507c,network=Network(ad99d772-7d76-4d5e-93f2-5b51bd1700c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c295a9-0e')
Nov 07 04:04:09 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Deleting instance files /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9_del
Nov 07 04:04:09 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Deletion of /opt/stack/data/nova/instances/6d43f26f-dfbb-4299-b875-f498979679d9_del complete
Nov 07 04:04:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:09 user nova-compute[74540]: INFO nova.compute.manager [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Terminating instance
Nov 07 04:04:09 user nova-compute[74540]: DEBUG nova.compute.manager [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:04:09 user nova-compute[74540]: INFO nova.compute.manager [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 07 04:04:09 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Instance destroyed successfully.
Nov 07 04:04:10 user nova-compute[74540]: DEBUG nova.objects.instance [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lazy-loading 'resources' on Instance uuid 5a9f46b2-f47c-44a7-9e54-aa167d6c720a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-270406895',display_name='tempest-ServerStableDeviceRescueTest-server-270406895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-270406895',id=3,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB73hKr0rCSaXcEdzAIV9bdsU5+khQO/C1hkKjkqXTy7pwY3QiFu4j8idpqpU2PBgsUP2QTfIFzopN/poLcBVGh0/WKe94Lh0RtHcChTpf0rxWKgCmEpAp0beMT3frmJpw==',key_name='tempest-keypair-672410008',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:01:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f20cf66849de49ce9591749b8a941d76',ramdisk_id='',reservation_id='r-ok1nm0rk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-700722702',owner_user_name='tempest-ServerStableDeviceRescueTest-700722702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1aae6f239de4d6994efd7eace1ceecc',uuid=5a9f46b2-f47c-44a7-9e54-aa167d6c720a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Converting VIF {"id": "b624973a-ace1-47d7-8733-2a76e946eaec", "address": "fa:16:3e:72:c8:7f", "network": {"id": "930b8cda-0528-4954-9f89-52be884a19fa", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1797737411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f20cf66849de49ce9591749b8a941d76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb624973a-ac", "ovs_interfaceid": "b624973a-ace1-47d7-8733-2a76e946eaec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:c8:7f,bridge_name='br-int',has_traffic_filtering=True,id=b624973a-ace1-47d7-8733-2a76e946eaec,network=Network(930b8cda-0528-4954-9f89-52be884a19fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624973a-ac') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG os_vif [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:c8:7f,bridge_name='br-int',has_traffic_filtering=True,id=b624973a-ace1-47d7-8733-2a76e946eaec,network=Network(930b8cda-0528-4954-9f89-52be884a19fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624973a-ac') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb624973a-ac, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b55a61d5-dedf-4a19-83fe-acc574a22c6e) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:04:10 user nova-compute[74540]: INFO os_vif [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:c8:7f,bridge_name='br-int',has_traffic_filtering=True,id=b624973a-ace1-47d7-8733-2a76e946eaec,network=Network(930b8cda-0528-4954-9f89-52be884a19fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb624973a-ac')
Nov 07 04:04:10 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Deleting instance files /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a_del
Nov 07 04:04:10 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Deletion of /opt/stack/data/nova/instances/5a9f46b2-f47c-44a7-9e54-aa167d6c720a_del complete
Nov 07 04:04:10 user nova-compute[74540]: INFO nova.compute.manager [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 07 04:04:10 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:04:10 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Took 1.09 seconds to deallocate network for instance.
Nov 07 04:04:10 user nova-compute[74540]: DEBUG nova.compute.manager [req-e30ec7bf-0f95-431c-a249-e566a0482c4d req-e9c63175-91e7-45f3-9b9a-9bda53a36d63 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received event network-vif-deleted-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:11 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Deleted allocations for instance 6d43f26f-dfbb-4299-b875-f498979679d9
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e5181e50-1ad6-4bbd-9a3d-5c5944aa08f1 req-c0aa728e-14da-4854-992e-6695241609dc service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Received event network-changed-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e5181e50-1ad6-4bbd-9a3d-5c5944aa08f1 req-c0aa728e-14da-4854-992e-6695241609dc service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Refreshing instance network info cache due to event network-changed-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e5181e50-1ad6-4bbd-9a3d-5c5944aa08f1 req-c0aa728e-14da-4854-992e-6695241609dc service nova] Acquiring lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e5181e50-1ad6-4bbd-9a3d-5c5944aa08f1 req-c0aa728e-14da-4854-992e-6695241609dc service nova] Acquired lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.network.neutron [req-e5181e50-1ad6-4bbd-9a3d-5c5944aa08f1 req-c0aa728e-14da-4854-992e-6695241609dc service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Refreshing network info cache for port ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8026954e-b6f6-45a6-8d4a-fa4f3137613e tempest-VolumesAdminNegativeTest-1758788930 tempest-VolumesAdminNegativeTest-1758788930-project-member] Lock "6d43f26f-dfbb-4299-b875-f498979679d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.964s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received event network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] No waiting events found dispatching network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:11 user nova-compute[74540]: WARNING nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received unexpected event network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c for instance with vm_state deleted and task_state None.
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received event network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] No waiting events found dispatching network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:11 user nova-compute[74540]: WARNING nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received unexpected event network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c for instance with vm_state deleted and task_state None.
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received event network-vif-unplugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] No waiting events found dispatching network-vif-unplugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:11 user nova-compute[74540]: WARNING nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received unexpected event network-vif-unplugged-93c295a9-0e82-4a04-9eab-7dea70ad507c for instance with vm_state deleted and task_state None.
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received event network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Acquiring lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Lock "6d43f26f-dfbb-4299-b875-f498979679d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] No waiting events found dispatching network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:11 user nova-compute[74540]: WARNING nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 6d43f26f-dfbb-4299-b875-f498979679d9] Received unexpected event network-vif-plugged-93c295a9-0e82-4a04-9eab-7dea70ad507c for instance with vm_state deleted and task_state None.
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-unplugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] No waiting events found dispatching network-vif-unplugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-unplugged-b624973a-ace1-47d7-8733-2a76e946eaec for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Acquiring lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] No waiting events found dispatching network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:11 user nova-compute[74540]: WARNING nova.compute.manager [req-e4444022-2f90-4f53-bbcf-5a8c6021f522 req-64625da4-7335-4d82-aa34-44fce6822d31 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received unexpected event network-vif-plugged-b624973a-ace1-47d7-8733-2a76e946eaec for instance with vm_state active and task_state deleting.
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:04:11 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Took 1.22 seconds to deallocate network for instance.
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.network.neutron [req-e5181e50-1ad6-4bbd-9a3d-5c5944aa08f1 req-c0aa728e-14da-4854-992e-6695241609dc service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updated VIF entry in instance network info cache for port ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG nova.network.neutron [req-e5181e50-1ad6-4bbd-9a3d-5c5944aa08f1 req-c0aa728e-14da-4854-992e-6695241609dc service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updating instance_info_cache with network_info: [{"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:04:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e5181e50-1ad6-4bbd-9a3d-5c5944aa08f1 req-c0aa728e-14da-4854-992e-6695241609dc service nova] Releasing lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:04:12 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:04:12 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:04:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:12 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Deleted allocations for instance 5a9f46b2-f47c-44a7-9e54-aa167d6c720a
Nov 07 04:04:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-055b8e0c-5204-4af1-ada2-6f2a2a04e8a9 tempest-ServerStableDeviceRescueTest-700722702 tempest-ServerStableDeviceRescueTest-700722702-project-member] Lock "5a9f46b2-f47c-44a7-9e54-aa167d6c720a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.791s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:13 user nova-compute[74540]: DEBUG nova.compute.manager [req-e1a15c60-4207-40d3-88a7-ce1b8fcda861 req-dd79bf6a-989b-4a4c-a30c-2547a77326e5 service nova] [instance: 5a9f46b2-f47c-44a7-9e54-aa167d6c720a] Received event network-vif-deleted-b624973a-ace1-47d7-8733-2a76e946eaec {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:25 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:04:28 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:04:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:32 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:04:34 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:04:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:35 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:04:35 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:04:35 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:04:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:04:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:04:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:39 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:04:39 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:04:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7520MB free_disk=25.249351501464844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance fab159b1-8768-4266-9a2f-3983628aeb86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a3cae7a7-223c-438e-8206-39e0f1683cb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6b84cdaa-6964-4e16-95b3-accb9086d871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 45cf1e18-0792-451b-8022-000ba35ad605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:04:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-494fa66c-14f9-4d1b-b971-983ef94a64c1 req-3a5c37db-b950-491b-98e1-1a721ca0fed7 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-changed-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-494fa66c-14f9-4d1b-b971-983ef94a64c1 req-3a5c37db-b950-491b-98e1-1a721ca0fed7 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Refreshing instance network info cache due to event network-changed-3432fa44-5aef-4f35-bc32-9c41738d5eba. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-494fa66c-14f9-4d1b-b971-983ef94a64c1 req-3a5c37db-b950-491b-98e1-1a721ca0fed7 service nova] Acquiring lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-494fa66c-14f9-4d1b-b971-983ef94a64c1 req-3a5c37db-b950-491b-98e1-1a721ca0fed7 service nova] Acquired lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:04:40 user nova-compute[74540]: DEBUG nova.network.neutron [req-494fa66c-14f9-4d1b-b971-983ef94a64c1 req-3a5c37db-b950-491b-98e1-1a721ca0fed7 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Refreshing network info cache for port 3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-494fa66c-14f9-4d1b-b971-983ef94a64c1 req-3a5c37db-b950-491b-98e1-1a721ca0fed7 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updated VIF entry in instance network info cache for port 3432fa44-5aef-4f35-bc32-9c41738d5eba. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-494fa66c-14f9-4d1b-b971-983ef94a64c1 req-3a5c37db-b950-491b-98e1-1a721ca0fed7 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updating instance_info_cache with network_info: [{"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-494fa66c-14f9-4d1b-b971-983ef94a64c1 req-3a5c37db-b950-491b-98e1-1a721ca0fed7 service nova] Releasing lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updating instance_info_cache with network_info: [{"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:04:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:04:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:47 user nova-compute[74540]: INFO nova.compute.manager [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Shelving
Nov 07 04:04:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-788993ae-74e7-4fd8-87da-ca3465b28ea8 req-ea274e56-b42c-4d45-b000-8c0357cf12b7 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-vif-unplugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-788993ae-74e7-4fd8-87da-ca3465b28ea8 req-ea274e56-b42c-4d45-b000-8c0357cf12b7 service nova] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-788993ae-74e7-4fd8-87da-ca3465b28ea8 req-ea274e56-b42c-4d45-b000-8c0357cf12b7 service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-788993ae-74e7-4fd8-87da-ca3465b28ea8 req-ea274e56-b42c-4d45-b000-8c0357cf12b7 service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-788993ae-74e7-4fd8-87da-ca3465b28ea8 req-ea274e56-b42c-4d45-b000-8c0357cf12b7 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] No waiting events found dispatching network-vif-unplugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:48 user nova-compute[74540]: WARNING nova.compute.manager [req-788993ae-74e7-4fd8-87da-ca3465b28ea8 req-ea274e56-b42c-4d45-b000-8c0357cf12b7 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received unexpected event network-vif-unplugged-3432fa44-5aef-4f35-bc32-9c41738d5eba for instance with vm_state active and task_state shelving.
Nov 07 04:04:48 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Instance destroyed successfully.
Nov 07 04:04:48 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Beginning cold snapshot process
Nov 07 04:04:48 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:04:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk /opt/stack/data/nova/instances/snapshots/tmpoxrp8a2z/4a15a2ae38db41f0869f50141297bdd4 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:04:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk /opt/stack/data/nova/instances/snapshots/tmpoxrp8a2z/4a15a2ae38db41f0869f50141297bdd4" returned: 0 in 0.534s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:04:49 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Snapshot extracted, beginning image upload
Nov 07 04:04:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-90dae017-4563-4ae5-9643-7fceb0c737fa req-49143d48-0e84-44e0-8eb1-1bcc94a05779 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-90dae017-4563-4ae5-9643-7fceb0c737fa req-49143d48-0e84-44e0-8eb1-1bcc94a05779 service nova] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-90dae017-4563-4ae5-9643-7fceb0c737fa req-49143d48-0e84-44e0-8eb1-1bcc94a05779 service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-90dae017-4563-4ae5-9643-7fceb0c737fa req-49143d48-0e84-44e0-8eb1-1bcc94a05779 service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-90dae017-4563-4ae5-9643-7fceb0c737fa req-49143d48-0e84-44e0-8eb1-1bcc94a05779 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] No waiting events found dispatching network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:04:50 user nova-compute[74540]: WARNING nova.compute.manager [req-90dae017-4563-4ae5-9643-7fceb0c737fa req-49143d48-0e84-44e0-8eb1-1bcc94a05779 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received unexpected event network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba for instance with vm_state active and task_state shelving_image_uploading.
Nov 07 04:04:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:52 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Snapshot image upload complete
Nov 07 04:04:52 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:04:52 user nova-compute[74540]: INFO nova.compute.manager [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Shelve offloading
Nov 07 04:04:52 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Instance destroyed successfully.
Nov 07 04:04:52 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:04:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:04:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquired lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:04:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:04:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updating instance_info_cache with network_info: [{"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:04:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Releasing lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Instance destroyed successfully.
Nov 07 04:04:53 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'resources' on Instance uuid 6b84cdaa-6964-4e16-95b3-accb9086d871 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1095963237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1095963237',id=16,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5yy6Ou6kxxgeLhllpuYaf0VwnElOEVwXCvSmoufn/x1hVdPoLTWq/xAccmDfVJm0Pb13vhiJ7+4h/8g8wd6kea82ruX/BzZQdz547wqDGDAIFfvjPZ7iXZGlR7HPfLzA==',key_name='tempest-keypair-660584599',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:02:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='796865203135404b8624363d533ae6fe',ramdisk_id='',reservation_id='r-cso2bngu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952443794',owner_user_name='tempest-AttachVolumeShelveTestJSON-952443794-project-member',shelved_at='2023-11-07T04:04:52.153545',shelved_host='user',shelved_image_id='dff8b747-7313-4963-aa69-6c2e68878c8d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:04:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fad238078941dba4cc57406b1c69ed',uuid=6b84cdaa-6964-4e16-95b3-accb9086d871,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converting VIF {"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG os_vif [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3432fa44-5a, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77140bfd-b390-4765-921b-9e45a464f0bd) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-26369b9f-3fe8-4654-9141-040b42b0bced req-dc0ec079-f5ad-474c-ac22-81c5ef90b710 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-changed-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-26369b9f-3fe8-4654-9141-040b42b0bced req-dc0ec079-f5ad-474c-ac22-81c5ef90b710 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Refreshing instance network info cache due to event network-changed-3432fa44-5aef-4f35-bc32-9c41738d5eba. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-26369b9f-3fe8-4654-9141-040b42b0bced req-dc0ec079-f5ad-474c-ac22-81c5ef90b710 service nova] Acquiring lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-26369b9f-3fe8-4654-9141-040b42b0bced req-dc0ec079-f5ad-474c-ac22-81c5ef90b710 service nova] Acquired lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG nova.network.neutron [req-26369b9f-3fe8-4654-9141-040b42b0bced req-dc0ec079-f5ad-474c-ac22-81c5ef90b710 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Refreshing network info cache for port 3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:04:53 user nova-compute[74540]: INFO os_vif [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a')
Nov 07 04:04:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Deleting instance files /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871_del
Nov 07 04:04:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Deletion of /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871_del complete
Nov 07 04:04:53 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Deleted allocations for instance 6b84cdaa-6964-4e16-95b3-accb9086d871
Nov 07 04:04:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'numa_topology' on Instance uuid 6b84cdaa-6964-4e16-95b3-accb9086d871 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:04:53 user nova-compute[74540]: DEBUG nova.objects.base [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Object Instance<6b84cdaa-6964-4e16-95b3-accb9086d871> lazy-loaded attributes: resources,numa_topology {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:04:54 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:04:54 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:04:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:54 user nova-compute[74540]: DEBUG nova.network.neutron [req-26369b9f-3fe8-4654-9141-040b42b0bced req-dc0ec079-f5ad-474c-ac22-81c5ef90b710 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updated VIF entry in instance network info cache for port 3432fa44-5aef-4f35-bc32-9c41738d5eba. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:04:54 user nova-compute[74540]: DEBUG nova.network.neutron [req-26369b9f-3fe8-4654-9141-040b42b0bced req-dc0ec079-f5ad-474c-ac22-81c5ef90b710 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updating instance_info_cache with network_info: [{"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3432fa44-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:04:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-26369b9f-3fe8-4654-9141-040b42b0bced req-dc0ec079-f5ad-474c-ac22-81c5ef90b710 service nova] Releasing lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:04:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9aa585c-7e0d-4586-b9cf-9dd00056a46a tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.291s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:04:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:04:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:05:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:05:15 user nova-compute[74540]: INFO nova.compute.claims [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Claim successful on node user
Nov 07 04:05:16 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:05:16 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:05:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG nova.policy [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3b660fa816a404196af3027d19aea51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60a9f3df6bba4675b2332ac4ded5373e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:05:16 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Creating image(s)
Nov 07 04:05:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "/opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "/opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "/opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.231s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:05:17 user nova-compute[74540]: INFO nova.compute.claims [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Claim successful on node user
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.222s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk 1073741824" returned: 0 in 0.071s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Successfully created port: 82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Cannot resize image /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Ensure instance console log exists: /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.compute.manager [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:05:18 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.compute.manager [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.policy [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd0ca1c305c04866b3323a98c6796ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e4bbbf680d48fe8534c9ebe909fd50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.compute.manager [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:05:18 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Creating image(s)
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "/opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "/opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "/opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Successfully updated port: 82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquired lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-c7daac71-b7ab-4c11-b9c7-9fdccc6f3bc1 req-7edaae29-1408-4f7f-88e2-2fb7df63b210 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-changed-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-c7daac71-b7ab-4c11-b9c7-9fdccc6f3bc1 req-7edaae29-1408-4f7f-88e2-2fb7df63b210 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Refreshing instance network info cache due to event network-changed-82decd3b-b1ba-4b4c-88ab-fbae31e34394. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7daac71-b7ab-4c11-b9c7-9fdccc6f3bc1 req-7edaae29-1408-4f7f-88e2-2fb7df63b210 service nova] Acquiring lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.209s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk 1073741824" returned: 0 in 0.057s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.217s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updating instance_info_cache with network_info: [{"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Releasing lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Instance network_info: |[{"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7daac71-b7ab-4c11-b9c7-9fdccc6f3bc1 req-7edaae29-1408-4f7f-88e2-2fb7df63b210 service nova] Acquired lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-c7daac71-b7ab-4c11-b9c7-9fdccc6f3bc1 req-7edaae29-1408-4f7f-88e2-2fb7df63b210 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Refreshing network info cache for port 82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Start _get_guest_xml network_info=[{"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:05:19 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:05:19 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1133225386',display_name='tempest-ServerRescueNegativeTestJSON-server-1133225386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1133225386',id=20,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBj9JGEc9VyV8YeUoPMa9NDSJ54Ho4a2bbet4FxPNE2x3GRflCHypDOaqiWCZvHqb4axwgd1tVOhLjsH76krDJ7R06NDk6czZdeoCJ8xnQsEpDVmGkxfD1VqTkuh/PGlLA==',key_name='tempest-keypair-374854339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60a9f3df6bba4675b2332ac4ded5373e',ramdisk_id='',reservation_id='r-jg0mo70g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1326022799',owner_user_name='tempest-ServerRescueNegativeTestJSON-1326022799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:05:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b660fa816a404196af3027d19aea51',uuid=d61ec49c-3345-4808-bfcd-a9d925fe1918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converting VIF {"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:3f:df,bridge_name='br-int',has_traffic_filtering=True,id=82decd3b-b1ba-4b4c-88ab-fbae31e34394,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82decd3b-b1') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.objects.instance [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'pci_devices' on Instance uuid d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:05:19 user nova-compute[74540]:   <uuid>d61ec49c-3345-4808-bfcd-a9d925fe1918</uuid>
Nov 07 04:05:19 user nova-compute[74540]:   <name>instance-00000014</name>
Nov 07 04:05:19 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:05:19 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:05:19 user nova-compute[74540]:   <metadata>
Nov 07 04:05:19 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:05:19 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:05:19 user nova-compute[74540]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1133225386</nova:name>
Nov 07 04:05:19 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:05:19</nova:creationTime>
Nov 07 04:05:19 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:05:19 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:05:19 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:05:19 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:05:19 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:05:19 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:05:19 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:05:19 user nova-compute[74540]:       <nova:owner>
Nov 07 04:05:19 user nova-compute[74540]:         <nova:user uuid="c3b660fa816a404196af3027d19aea51">tempest-ServerRescueNegativeTestJSON-1326022799-project-member</nova:user>
Nov 07 04:05:19 user nova-compute[74540]:         <nova:project uuid="60a9f3df6bba4675b2332ac4ded5373e">tempest-ServerRescueNegativeTestJSON-1326022799</nova:project>
Nov 07 04:05:19 user nova-compute[74540]:       </nova:owner>
Nov 07 04:05:19 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:05:19 user nova-compute[74540]:       <nova:ports>
Nov 07 04:05:19 user nova-compute[74540]:         <nova:port uuid="82decd3b-b1ba-4b4c-88ab-fbae31e34394">
Nov 07 04:05:19 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:05:19 user nova-compute[74540]:         </nova:port>
Nov 07 04:05:19 user nova-compute[74540]:       </nova:ports>
Nov 07 04:05:19 user nova-compute[74540]:     </nova:instance>
Nov 07 04:05:19 user nova-compute[74540]:   </metadata>
Nov 07 04:05:19 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:05:19 user nova-compute[74540]:     <system>
Nov 07 04:05:19 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:05:19 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:05:19 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:05:19 user nova-compute[74540]:       <entry name="serial">d61ec49c-3345-4808-bfcd-a9d925fe1918</entry>
Nov 07 04:05:19 user nova-compute[74540]:       <entry name="uuid">d61ec49c-3345-4808-bfcd-a9d925fe1918</entry>
Nov 07 04:05:19 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:05:19 user nova-compute[74540]:     </system>
Nov 07 04:05:19 user nova-compute[74540]:   </sysinfo>
Nov 07 04:05:19 user nova-compute[74540]:   <os>
Nov 07 04:05:19 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:05:19 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:05:19 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:05:19 user nova-compute[74540]:   </os>
Nov 07 04:05:19 user nova-compute[74540]:   <features>
Nov 07 04:05:19 user nova-compute[74540]:     <acpi/>
Nov 07 04:05:19 user nova-compute[74540]:     <apic/>
Nov 07 04:05:19 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:05:19 user nova-compute[74540]:   </features>
Nov 07 04:05:19 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:05:19 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:05:19 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:05:19 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:05:19 user nova-compute[74540]:   </clock>
Nov 07 04:05:19 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:05:19 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:05:19 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:05:19 user nova-compute[74540]:   </cpu>
Nov 07 04:05:19 user nova-compute[74540]:   <devices>
Nov 07 04:05:19 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:05:19 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:05:19 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk"/>
Nov 07 04:05:19 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:05:19 user nova-compute[74540]:     </disk>
Nov 07 04:05:19 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:05:19 user nova-compute[74540]:       <mac address="fa:16:3e:25:3f:df"/>
Nov 07 04:05:19 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:05:19 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:05:19 user nova-compute[74540]:       <target dev="tap82decd3b-b1"/>
Nov 07 04:05:19 user nova-compute[74540]:     </interface>
Nov 07 04:05:19 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:05:19 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/console.log" append="off"/>
Nov 07 04:05:19 user nova-compute[74540]:     </serial>
Nov 07 04:05:19 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:05:19 user nova-compute[74540]:     <video>
Nov 07 04:05:19 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:05:19 user nova-compute[74540]:     </video>
Nov 07 04:05:19 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:05:19 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:05:19 user nova-compute[74540]:     </rng>
Nov 07 04:05:19 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:05:19 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:05:19 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:05:19 user nova-compute[74540]:     </memballoon>
Nov 07 04:05:19 user nova-compute[74540]:   </devices>
Nov 07 04:05:19 user nova-compute[74540]: </domain>
Nov 07 04:05:19 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1133225386',display_name='tempest-ServerRescueNegativeTestJSON-server-1133225386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1133225386',id=20,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBj9JGEc9VyV8YeUoPMa9NDSJ54Ho4a2bbet4FxPNE2x3GRflCHypDOaqiWCZvHqb4axwgd1tVOhLjsH76krDJ7R06NDk6czZdeoCJ8xnQsEpDVmGkxfD1VqTkuh/PGlLA==',key_name='tempest-keypair-374854339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60a9f3df6bba4675b2332ac4ded5373e',ramdisk_id='',reservation_id='r-jg0mo70g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1326022799',owner_user_name='tempest-ServerRescueNegativeTestJSON-1326022799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:05:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b660fa816a404196af3027d19aea51',uuid=d61ec49c-3345-4808-bfcd-a9d925fe1918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converting VIF {"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:3f:df,bridge_name='br-int',has_traffic_filtering=True,id=82decd3b-b1ba-4b4c-88ab-fbae31e34394,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82decd3b-b1') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG os_vif [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:3f:df,bridge_name='br-int',has_traffic_filtering=True,id=82decd3b-b1ba-4b4c-88ab-fbae31e34394,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82decd3b-b1') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1c9fe56-f76a-5ac4-9cbe-690067cae281', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.network.neutron [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Successfully created port: 32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82decd3b-b1, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82decd3b-b1, col_values=(('qos', UUID('3b7b047f-7701-43da-8893-20c79cf91047')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82decd3b-b1, col_values=(('external_ids', {'iface-id': '82decd3b-b1ba-4b4c-88ab-fbae31e34394', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:3f:df', 'vm-uuid': 'd61ec49c-3345-4808-bfcd-a9d925fe1918'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Cannot resize image /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Ensure instance console log exists: /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:19 user nova-compute[74540]: INFO os_vif [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:3f:df,bridge_name='br-int',has_traffic_filtering=True,id=82decd3b-b1ba-4b4c-88ab-fbae31e34394,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82decd3b-b1')
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No VIF found with MAC fa:16:3e:25:3f:df, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-c7daac71-b7ab-4c11-b9c7-9fdccc6f3bc1 req-7edaae29-1408-4f7f-88e2-2fb7df63b210 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updated VIF entry in instance network info cache for port 82decd3b-b1ba-4b4c-88ab-fbae31e34394. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-c7daac71-b7ab-4c11-b9c7-9fdccc6f3bc1 req-7edaae29-1408-4f7f-88e2-2fb7df63b210 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updating instance_info_cache with network_info: [{"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7daac71-b7ab-4c11-b9c7-9fdccc6f3bc1 req-7edaae29-1408-4f7f-88e2-2fb7df63b210 service nova] Releasing lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.network.neutron [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Successfully updated port: 32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "refresh_cache-74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquired lock "refresh_cache-74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.network.neutron [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-a27ebf49-a9e2-4b6c-bdc3-812cf3ac62af req-cd965db3-86ae-4ecb-a650-d913cf2b9f95 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received event network-changed-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-a27ebf49-a9e2-4b6c-bdc3-812cf3ac62af req-cd965db3-86ae-4ecb-a650-d913cf2b9f95 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Refreshing instance network info cache due to event network-changed-32b18c39-92d0-488b-891e-fd7b5f9b85d1. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a27ebf49-a9e2-4b6c-bdc3-812cf3ac62af req-cd965db3-86ae-4ecb-a650-d913cf2b9f95 service nova] Acquiring lock "refresh_cache-74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:05:19 user nova-compute[74540]: DEBUG nova.network.neutron [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.network.neutron [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Updating instance_info_cache with network_info: [{"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Releasing lock "refresh_cache-74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Instance network_info: |[{"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a27ebf49-a9e2-4b6c-bdc3-812cf3ac62af req-cd965db3-86ae-4ecb-a650-d913cf2b9f95 service nova] Acquired lock "refresh_cache-74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-a27ebf49-a9e2-4b6c-bdc3-812cf3ac62af req-cd965db3-86ae-4ecb-a650-d913cf2b9f95 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Refreshing network info cache for port 32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Start _get_guest_xml network_info=[{"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:05:20 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:05:20 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-905638517',display_name='tempest-tempest.common.compute-instance-905638517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-905638517',id=21,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnVI6gwzel5Ql/BuaLSS3BsMPir/RBkcVGKmw5hj9mqhnJPLS6fivjrEUdxmnvOsXyWSIwfONC16BOCTgU/hkRjILu4a9Q61a1FizttTQVjvxUM6qM6uvcsjWMI5HVtcA==',key_name='tempest-keypair-1497340994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-hs9y32ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=74271ad1-5dc8-4f92-83cf-4f31d05b0dd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.objects.instance [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lazy-loading 'pci_devices' on Instance uuid 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:05:20 user nova-compute[74540]:   <uuid>74271ad1-5dc8-4f92-83cf-4f31d05b0dd6</uuid>
Nov 07 04:05:20 user nova-compute[74540]:   <name>instance-00000015</name>
Nov 07 04:05:20 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:05:20 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:05:20 user nova-compute[74540]:   <metadata>
Nov 07 04:05:20 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:05:20 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:05:20 user nova-compute[74540]:       <nova:name>tempest-tempest.common.compute-instance-905638517</nova:name>
Nov 07 04:05:20 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:05:20</nova:creationTime>
Nov 07 04:05:20 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:05:20 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:05:20 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:05:20 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:05:20 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:05:20 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:05:20 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:05:20 user nova-compute[74540]:       <nova:owner>
Nov 07 04:05:20 user nova-compute[74540]:         <nova:user uuid="bd0ca1c305c04866b3323a98c6796ded">tempest-ServerActionsTestOtherA-28801548-project-member</nova:user>
Nov 07 04:05:20 user nova-compute[74540]:         <nova:project uuid="04e4bbbf680d48fe8534c9ebe909fd50">tempest-ServerActionsTestOtherA-28801548</nova:project>
Nov 07 04:05:20 user nova-compute[74540]:       </nova:owner>
Nov 07 04:05:20 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:05:20 user nova-compute[74540]:       <nova:ports>
Nov 07 04:05:20 user nova-compute[74540]:         <nova:port uuid="32b18c39-92d0-488b-891e-fd7b5f9b85d1">
Nov 07 04:05:20 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 07 04:05:20 user nova-compute[74540]:         </nova:port>
Nov 07 04:05:20 user nova-compute[74540]:       </nova:ports>
Nov 07 04:05:20 user nova-compute[74540]:     </nova:instance>
Nov 07 04:05:20 user nova-compute[74540]:   </metadata>
Nov 07 04:05:20 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:05:20 user nova-compute[74540]:     <system>
Nov 07 04:05:20 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:05:20 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:05:20 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:05:20 user nova-compute[74540]:       <entry name="serial">74271ad1-5dc8-4f92-83cf-4f31d05b0dd6</entry>
Nov 07 04:05:20 user nova-compute[74540]:       <entry name="uuid">74271ad1-5dc8-4f92-83cf-4f31d05b0dd6</entry>
Nov 07 04:05:20 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:05:20 user nova-compute[74540]:     </system>
Nov 07 04:05:20 user nova-compute[74540]:   </sysinfo>
Nov 07 04:05:20 user nova-compute[74540]:   <os>
Nov 07 04:05:20 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:05:20 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:05:20 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:05:20 user nova-compute[74540]:   </os>
Nov 07 04:05:20 user nova-compute[74540]:   <features>
Nov 07 04:05:20 user nova-compute[74540]:     <acpi/>
Nov 07 04:05:20 user nova-compute[74540]:     <apic/>
Nov 07 04:05:20 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:05:20 user nova-compute[74540]:   </features>
Nov 07 04:05:20 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:05:20 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:05:20 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:05:20 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:05:20 user nova-compute[74540]:   </clock>
Nov 07 04:05:20 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:05:20 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:05:20 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:05:20 user nova-compute[74540]:   </cpu>
Nov 07 04:05:20 user nova-compute[74540]:   <devices>
Nov 07 04:05:20 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:05:20 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:05:20 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk"/>
Nov 07 04:05:20 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:05:20 user nova-compute[74540]:     </disk>
Nov 07 04:05:20 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:05:20 user nova-compute[74540]:       <mac address="fa:16:3e:21:1b:68"/>
Nov 07 04:05:20 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:05:20 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:05:20 user nova-compute[74540]:       <target dev="tap32b18c39-92"/>
Nov 07 04:05:20 user nova-compute[74540]:     </interface>
Nov 07 04:05:20 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:05:20 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/console.log" append="off"/>
Nov 07 04:05:20 user nova-compute[74540]:     </serial>
Nov 07 04:05:20 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:05:20 user nova-compute[74540]:     <video>
Nov 07 04:05:20 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:05:20 user nova-compute[74540]:     </video>
Nov 07 04:05:20 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:05:20 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:05:20 user nova-compute[74540]:     </rng>
Nov 07 04:05:20 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:05:20 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:05:20 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:05:20 user nova-compute[74540]:     </memballoon>
Nov 07 04:05:20 user nova-compute[74540]:   </devices>
Nov 07 04:05:20 user nova-compute[74540]: </domain>
Nov 07 04:05:20 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-905638517',display_name='tempest-tempest.common.compute-instance-905638517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-905638517',id=21,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnVI6gwzel5Ql/BuaLSS3BsMPir/RBkcVGKmw5hj9mqhnJPLS6fivjrEUdxmnvOsXyWSIwfONC16BOCTgU/hkRjILu4a9Q61a1FizttTQVjvxUM6qM6uvcsjWMI5HVtcA==',key_name='tempest-keypair-1497340994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-hs9y32ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=74271ad1-5dc8-4f92-83cf-4f31d05b0dd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG os_vif [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebfa8a40-a0b9-50f8-924c-8aa0f34c9011', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32b18c39-92, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32b18c39-92, col_values=(('qos', UUID('466e9112-e5f5-4b4b-a3c3-2cbe06de91b2')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32b18c39-92, col_values=(('external_ids', {'iface-id': '32b18c39-92d0-488b-891e-fd7b5f9b85d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:1b:68', 'vm-uuid': '74271ad1-5dc8-4f92-83cf-4f31d05b0dd6'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:20 user nova-compute[74540]: INFO os_vif [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92')
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No VIF found with MAC fa:16:3e:21:1b:68, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-a27ebf49-a9e2-4b6c-bdc3-812cf3ac62af req-cd965db3-86ae-4ecb-a650-d913cf2b9f95 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Updated VIF entry in instance network info cache for port 32b18c39-92d0-488b-891e-fd7b5f9b85d1. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-a27ebf49-a9e2-4b6c-bdc3-812cf3ac62af req-cd965db3-86ae-4ecb-a650-d913cf2b9f95 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Updating instance_info_cache with network_info: [{"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a27ebf49-a9e2-4b6c-bdc3-812cf3ac62af req-cd965db3-86ae-4ecb-a650-d913cf2b9f95 service nova] Releasing lock "refresh_cache-74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:05:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-e499b6b8-9bfb-4e62-a7db-82651d38c494 req-74caf079-3b53-4960-8d63-3eb0f289e12d service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e499b6b8-9bfb-4e62-a7db-82651d38c494 req-74caf079-3b53-4960-8d63-3eb0f289e12d service nova] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e499b6b8-9bfb-4e62-a7db-82651d38c494 req-74caf079-3b53-4960-8d63-3eb0f289e12d service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e499b6b8-9bfb-4e62-a7db-82651d38c494 req-74caf079-3b53-4960-8d63-3eb0f289e12d service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-e499b6b8-9bfb-4e62-a7db-82651d38c494 req-74caf079-3b53-4960-8d63-3eb0f289e12d service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] No waiting events found dispatching network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:05:21 user nova-compute[74540]: WARNING nova.compute.manager [req-e499b6b8-9bfb-4e62-a7db-82651d38c494 req-74caf079-3b53-4960-8d63-3eb0f289e12d service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received unexpected event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 for instance with vm_state building and task_state spawning.
Nov 07 04:05:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-e499b6b8-9bfb-4e62-a7db-82651d38c494 req-74caf079-3b53-4960-8d63-3eb0f289e12d service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e499b6b8-9bfb-4e62-a7db-82651d38c494 req-74caf079-3b53-4960-8d63-3eb0f289e12d service nova] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e499b6b8-9bfb-4e62-a7db-82651d38c494 req-74caf079-3b53-4960-8d63-3eb0f289e12d service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e499b6b8-9bfb-4e62-a7db-82651d38c494 req-74caf079-3b53-4960-8d63-3eb0f289e12d service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-e499b6b8-9bfb-4e62-a7db-82651d38c494 req-74caf079-3b53-4960-8d63-3eb0f289e12d service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] No waiting events found dispatching network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:05:21 user nova-compute[74540]: WARNING nova.compute.manager [req-e499b6b8-9bfb-4e62-a7db-82651d38c494 req-74caf079-3b53-4960-8d63-3eb0f289e12d service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received unexpected event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 for instance with vm_state building and task_state spawning.
Nov 07 04:05:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-9b434f82-dd7e-4171-8d22-185acc8a4b7b req-1c04a271-de0a-4556-875e-46f42edbb6fe service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received event network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9b434f82-dd7e-4171-8d22-185acc8a4b7b req-1c04a271-de0a-4556-875e-46f42edbb6fe service nova] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9b434f82-dd7e-4171-8d22-185acc8a4b7b req-1c04a271-de0a-4556-875e-46f42edbb6fe service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9b434f82-dd7e-4171-8d22-185acc8a4b7b req-1c04a271-de0a-4556-875e-46f42edbb6fe service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-9b434f82-dd7e-4171-8d22-185acc8a4b7b req-1c04a271-de0a-4556-875e-46f42edbb6fe service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] No waiting events found dispatching network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:05:24 user nova-compute[74540]: WARNING nova.compute.manager [req-9b434f82-dd7e-4171-8d22-185acc8a4b7b req-1c04a271-de0a-4556-875e-46f42edbb6fe service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received unexpected event network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 for instance with vm_state building and task_state spawning.
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-9b434f82-dd7e-4171-8d22-185acc8a4b7b req-1c04a271-de0a-4556-875e-46f42edbb6fe service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received event network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9b434f82-dd7e-4171-8d22-185acc8a4b7b req-1c04a271-de0a-4556-875e-46f42edbb6fe service nova] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9b434f82-dd7e-4171-8d22-185acc8a4b7b req-1c04a271-de0a-4556-875e-46f42edbb6fe service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9b434f82-dd7e-4171-8d22-185acc8a4b7b req-1c04a271-de0a-4556-875e-46f42edbb6fe service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-9b434f82-dd7e-4171-8d22-185acc8a4b7b req-1c04a271-de0a-4556-875e-46f42edbb6fe service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] No waiting events found dispatching network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:05:24 user nova-compute[74540]: WARNING nova.compute.manager [req-9b434f82-dd7e-4171-8d22-185acc8a4b7b req-1c04a271-de0a-4556-875e-46f42edbb6fe service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received unexpected event network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 for instance with vm_state building and task_state spawning.
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:05:24 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Instance spawned successfully.
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:24 user nova-compute[74540]: INFO nova.compute.manager [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Took 7.84 seconds to spawn the instance on the hypervisor.
Nov 07 04:05:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:05:24 user nova-compute[74540]: INFO nova.compute.manager [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Took 8.86 seconds to build instance.
Nov 07 04:05:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c766dd30-64c2-4e27-813b-628250ccf0b0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.014s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:25 user nova-compute[74540]: DEBUG nova.compute.manager [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:05:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:05:25 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Instance spawned successfully.
Nov 07 04:05:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:05:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:25 user nova-compute[74540]: INFO nova.compute.manager [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Took 6.93 seconds to spawn the instance on the hypervisor.
Nov 07 04:05:25 user nova-compute[74540]: DEBUG nova.compute.manager [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:05:25 user nova-compute[74540]: INFO nova.compute.manager [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Took 8.19 seconds to build instance.
Nov 07 04:05:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b2269d44-d994-423c-9f31-3c0646d8e0ee tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.354s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:25 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:05:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:30 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:05:34 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:05:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:35 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:05:35 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:05:36 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:05:37 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:05:37 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:05:37 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:05:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:37 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:05:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG nova.objects.instance [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lazy-loading 'flavor' on Instance uuid 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:05:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:41 user nova-compute[74540]: INFO nova.compute.manager [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Attaching volume 56403c09-1336-4c5f-83d3-aa4b6092b2c8 to /dev/vdb
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG os_brick.utils [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe10ef2-c69b-40fe-aa37-30da5e70db0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e297a51e-275a-4ddb-b5d2-ac099d6b4fc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61924e1-5d2b-40d2-b4d6-51e1af635957]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b421c432-ef92-4332-9786-b6ea4f17f743]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:05:41 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d5b255-9d38-4095-8e63-cb5371f5c760]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG os_brick.utils [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Updating existing volume attachment record: 768dee3c-35af-461c-bbd0-42ef3441a77d {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:42 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:05:42 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7489MB free_disk=25.19775390625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance fab159b1-8768-4266-9a2f-3983628aeb86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a3cae7a7-223c-438e-8206-39e0f1683cb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 45cf1e18-0792-451b-8022-000ba35ad605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d61ec49c-3345-4808-bfcd-a9d925fe1918 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:05:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:43 user nova-compute[74540]: INFO nova.compute.manager [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Terminating instance
Nov 07 04:05:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-78d3c8f0-fd3f-4459-9f5b-0d3b288911ae req-13ed03db-ac80-4d6c-9439-50c3474ba101 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-unplugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-78d3c8f0-fd3f-4459-9f5b-0d3b288911ae req-13ed03db-ac80-4d6c-9439-50c3474ba101 service nova] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-78d3c8f0-fd3f-4459-9f5b-0d3b288911ae req-13ed03db-ac80-4d6c-9439-50c3474ba101 service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-78d3c8f0-fd3f-4459-9f5b-0d3b288911ae req-13ed03db-ac80-4d6c-9439-50c3474ba101 service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-78d3c8f0-fd3f-4459-9f5b-0d3b288911ae req-13ed03db-ac80-4d6c-9439-50c3474ba101 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] No waiting events found dispatching network-vif-unplugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-78d3c8f0-fd3f-4459-9f5b-0d3b288911ae req-13ed03db-ac80-4d6c-9439-50c3474ba101 service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-unplugged-27e96706-586b-4c99-9b76-6073a1dda1c8 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "332796aa-adda-40ef-8650-126641e30821" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "332796aa-adda-40ef-8650-126641e30821" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:05:44 user nova-compute[74540]: INFO nova.compute.claims [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Claim successful on node user
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:05:44 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Instance destroyed successfully.
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.objects.instance [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lazy-loading 'resources' on Instance uuid a3cae7a7-223c-438e-8206-39e0f1683cb0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1210052302',display_name='tempest-ServerActionsTestOtherB-server-1210052302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1210052302',id=4,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPA4sa8gttNcUVG7dP3QNit/DgVEny+5q14Y5Nq4fULGEJH2XetZ4c/LpN/MeE1MeKbjuGhXIPyx37hOCdT8fI0kPAEfe6XDcs5qqFJVn5zBv9qgxSc44xeWnPbfk+DcLA==',key_name='tempest-keypair-1859375338',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:03:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ede989d4b3d34f1b996f135913039586',ramdisk_id='',reservation_id='r-kydyio2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-414073346',owner_user_name='tempest-ServerActionsTestOtherB-414073346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0218f41629a9468f80011fb04e917600',uuid=a3cae7a7-223c-438e-8206-39e0f1683cb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converting VIF {"id": "27e96706-586b-4c99-9b76-6073a1dda1c8", "address": "fa:16:3e:6b:66:f7", "network": {"id": "1d46cac8-a252-4c2e-a969-f61feeced630", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1299966827-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede989d4b3d34f1b996f135913039586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e96706-58", "ovs_interfaceid": "27e96706-586b-4c99-9b76-6073a1dda1c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_vif [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27e96706-58, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a241868e-4790-439e-a08f-805053ddeba4) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:44 user nova-compute[74540]: INFO os_vif [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:66:f7,bridge_name='br-int',has_traffic_filtering=True,id=27e96706-586b-4c99-9b76-6073a1dda1c8,network=Network(1d46cac8-a252-4c2e-a969-f61feeced630),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e96706-58')
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSskdBKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:05:44 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b6887e-0eef-4b8a-a432-cc9f8fcb04e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:05:44 user nova-compute[74540]: No targets found.
Nov 07 04:05:44 user nova-compute[74540]: iSNS:
Nov 07 04:05:44 user nova-compute[74540]: No targets found.
Nov 07 04:05:44 user nova-compute[74540]: STATIC:
Nov 07 04:05:44 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8
Nov 07 04:05:44 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:05:44 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:05:44 user nova-compute[74540]: FIRMWARE:
Nov 07 04:05:44 user nova-compute[74540]: No targets found.
Nov 07 04:05:44 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:05:44 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:05:44 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2271de45-2635-45e7-b80f-dfef7a09282c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a8c75f-8112-4794-9c30-40d96fef0ac7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:05:44 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 (non-flash)
Nov 07 04:05:44 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc389990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b462237d-3ac0-4c06-b89d-980e92506083]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ad56be-5d77-48a7-8da7-246f3ff561e6]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e523f395-1aaf-4280-9558-6b150764fbb4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[76013012-b5ec-4f23-93f5-a6ef0c4b801d]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf7e727-6926-4dc0-aaa2-2c506a08da0e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.network.neutron [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa49318-12bf-46ed-947a-d48357445153]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260]
Nov 07 04:05:44 user nova-compute[74540]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8, portal: 172.16.0.220,3260] successful.
Nov 07 04:05:44 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:44 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:615b5148-e91d-4c64-8ad2-084c8f7108e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e2e65d-38d6-4448-a82c-d30c3601606f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] <== disconnect_volume: return (340ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:05:44 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Deleting instance files /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0_del
Nov 07 04:05:44 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Deletion of /opt/stack/data/nova/instances/a3cae7a7-223c-438e-8206-39e0f1683cb0_del complete
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Updating instance_info_cache with network_info: [{"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:05:44 user nova-compute[74540]: DEBUG nova.policy [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f469ca83fe184f1698ed812016fb5b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7b6c7a58f842129f0f27294085214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:05:45 user nova-compute[74540]: INFO nova.compute.manager [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:05:45 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Creating image(s)
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk 1073741824" returned: 0 in 0.051s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG nova.network.neutron [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Successfully created port: abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Checking if we can resize image /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Cannot resize image /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Ensure instance console log exists: /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-19462752-d80b-448e-b602-0fd8b46e0ad0 req-8298ed32-1bcc-4fc8-af3c-1540ac40555f service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-19462752-d80b-448e-b602-0fd8b46e0ad0 req-8298ed32-1bcc-4fc8-af3c-1540ac40555f service nova] Acquiring lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-19462752-d80b-448e-b602-0fd8b46e0ad0 req-8298ed32-1bcc-4fc8-af3c-1540ac40555f service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-19462752-d80b-448e-b602-0fd8b46e0ad0 req-8298ed32-1bcc-4fc8-af3c-1540ac40555f service nova] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-19462752-d80b-448e-b602-0fd8b46e0ad0 req-8298ed32-1bcc-4fc8-af3c-1540ac40555f service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] No waiting events found dispatching network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:05:46 user nova-compute[74540]: WARNING nova.compute.manager [req-19462752-d80b-448e-b602-0fd8b46e0ad0 req-8298ed32-1bcc-4fc8-af3c-1540ac40555f service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received unexpected event network-vif-plugged-27e96706-586b-4c99-9b76-6073a1dda1c8 for instance with vm_state active and task_state deleting.
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-292ec687-f37c-428e-bfc1-429b5d693ace req-0b7a7a9d-314f-45b2-9ecf-51fea5a6264e service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-changed-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-292ec687-f37c-428e-bfc1-429b5d693ace req-0b7a7a9d-314f-45b2-9ecf-51fea5a6264e service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Refreshing instance network info cache due to event network-changed-134a19cd-7f72-44e1-82c0-5ffab04d98b6. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-292ec687-f37c-428e-bfc1-429b5d693ace req-0b7a7a9d-314f-45b2-9ecf-51fea5a6264e service nova] Acquiring lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-292ec687-f37c-428e-bfc1-429b5d693ace req-0b7a7a9d-314f-45b2-9ecf-51fea5a6264e service nova] Acquired lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.network.neutron [req-292ec687-f37c-428e-bfc1-429b5d693ace req-0b7a7a9d-314f-45b2-9ecf-51fea5a6264e service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Refreshing network info cache for port 134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:05:46 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Took 1.38 seconds to deallocate network for instance.
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.network.neutron [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Successfully updated port: abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-33792fd4-5c98-4141-92ae-8d095c8cb6dc req-4bc55b10-139b-4dfa-bba1-81c7408d8eaf service nova] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Received event network-vif-deleted-27e96706-586b-4c99-9b76-6073a1dda1c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquired lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.network.neutron [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.network.neutron [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.network.neutron [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Updating instance_info_cache with network_info: [{"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Releasing lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Instance network_info: |[{"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Start _get_guest_xml network_info=[{"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:05:46 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:05:46 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T04:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583633477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583633477',id=22,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7qsXSGLs+mC92IhCOo9fu/hTPQ5t1+AS7uJm7dv0HXMtIsNXU9ojGEHLtMbGRbnw9Yr5blprgPfBKlEZhTtmiDGlxqbo6WyQ4dq718r+8MLhSRzzyL2Hp9P9gMScDwtA==',key_name='tempest-keypair-1229377363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7b6c7a58f842129f0f27294085214a',ramdisk_id='',reservation_id='r-l9bskaef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-793581715',owner_user_name='tempest-TaggedAttachmentsTest-793581715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f469ca83fe184f1698ed812016fb5b64',uuid=332796aa-adda-40ef-8650-126641e30821,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converting VIF {"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:77:3f,bridge_name='br-int',has_traffic_filtering=True,id=abb88c7a-347e-428e-8069-d2419ed701c3,network=Network(d457440c-d143-48a1-bb7c-231fad9d0448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb88c7a-34') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.objects.instance [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lazy-loading 'pci_devices' on Instance uuid 332796aa-adda-40ef-8650-126641e30821 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:05:46 user nova-compute[74540]:   <uuid>332796aa-adda-40ef-8650-126641e30821</uuid>
Nov 07 04:05:46 user nova-compute[74540]:   <name>instance-00000016</name>
Nov 07 04:05:46 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:05:46 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:05:46 user nova-compute[74540]:   <metadata>
Nov 07 04:05:46 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:05:46 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:05:46 user nova-compute[74540]:       <nova:name>tempest-device-tagging-server-1583633477</nova:name>
Nov 07 04:05:46 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:05:46</nova:creationTime>
Nov 07 04:05:46 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:05:46 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:05:46 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:05:46 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:05:46 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:05:46 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:05:46 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:05:46 user nova-compute[74540]:       <nova:owner>
Nov 07 04:05:46 user nova-compute[74540]:         <nova:user uuid="f469ca83fe184f1698ed812016fb5b64">tempest-TaggedAttachmentsTest-793581715-project-member</nova:user>
Nov 07 04:05:46 user nova-compute[74540]:         <nova:project uuid="ac7b6c7a58f842129f0f27294085214a">tempest-TaggedAttachmentsTest-793581715</nova:project>
Nov 07 04:05:46 user nova-compute[74540]:       </nova:owner>
Nov 07 04:05:46 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:05:46 user nova-compute[74540]:       <nova:ports>
Nov 07 04:05:46 user nova-compute[74540]:         <nova:port uuid="abb88c7a-347e-428e-8069-d2419ed701c3">
Nov 07 04:05:46 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:05:46 user nova-compute[74540]:         </nova:port>
Nov 07 04:05:46 user nova-compute[74540]:       </nova:ports>
Nov 07 04:05:46 user nova-compute[74540]:     </nova:instance>
Nov 07 04:05:46 user nova-compute[74540]:   </metadata>
Nov 07 04:05:46 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:05:46 user nova-compute[74540]:     <system>
Nov 07 04:05:46 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:05:46 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:05:46 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:05:46 user nova-compute[74540]:       <entry name="serial">332796aa-adda-40ef-8650-126641e30821</entry>
Nov 07 04:05:46 user nova-compute[74540]:       <entry name="uuid">332796aa-adda-40ef-8650-126641e30821</entry>
Nov 07 04:05:46 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:05:46 user nova-compute[74540]:     </system>
Nov 07 04:05:46 user nova-compute[74540]:   </sysinfo>
Nov 07 04:05:46 user nova-compute[74540]:   <os>
Nov 07 04:05:46 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:05:46 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:05:46 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:05:46 user nova-compute[74540]:   </os>
Nov 07 04:05:46 user nova-compute[74540]:   <features>
Nov 07 04:05:46 user nova-compute[74540]:     <acpi/>
Nov 07 04:05:46 user nova-compute[74540]:     <apic/>
Nov 07 04:05:46 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:05:46 user nova-compute[74540]:   </features>
Nov 07 04:05:46 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:05:46 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:05:46 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:05:46 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:05:46 user nova-compute[74540]:   </clock>
Nov 07 04:05:46 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:05:46 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:05:46 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:05:46 user nova-compute[74540]:   </cpu>
Nov 07 04:05:46 user nova-compute[74540]:   <devices>
Nov 07 04:05:46 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:05:46 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:05:46 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk"/>
Nov 07 04:05:46 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:05:46 user nova-compute[74540]:     </disk>
Nov 07 04:05:46 user nova-compute[74540]:     <disk type="file" device="cdrom">
Nov 07 04:05:46 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none"/>
Nov 07 04:05:46 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk.config"/>
Nov 07 04:05:46 user nova-compute[74540]:       <target dev="hda" bus="ide"/>
Nov 07 04:05:46 user nova-compute[74540]:     </disk>
Nov 07 04:05:46 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:05:46 user nova-compute[74540]:       <mac address="fa:16:3e:2e:77:3f"/>
Nov 07 04:05:46 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:05:46 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:05:46 user nova-compute[74540]:       <target dev="tapabb88c7a-34"/>
Nov 07 04:05:46 user nova-compute[74540]:     </interface>
Nov 07 04:05:46 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:05:46 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/console.log" append="off"/>
Nov 07 04:05:46 user nova-compute[74540]:     </serial>
Nov 07 04:05:46 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:05:46 user nova-compute[74540]:     <video>
Nov 07 04:05:46 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:05:46 user nova-compute[74540]:     </video>
Nov 07 04:05:46 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:05:46 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:05:46 user nova-compute[74540]:     </rng>
Nov 07 04:05:46 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:05:46 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:05:46 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:05:46 user nova-compute[74540]:     </memballoon>
Nov 07 04:05:46 user nova-compute[74540]:   </devices>
Nov 07 04:05:46 user nova-compute[74540]: </domain>
Nov 07 04:05:46 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T04:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583633477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583633477',id=22,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7qsXSGLs+mC92IhCOo9fu/hTPQ5t1+AS7uJm7dv0HXMtIsNXU9ojGEHLtMbGRbnw9Yr5blprgPfBKlEZhTtmiDGlxqbo6WyQ4dq718r+8MLhSRzzyL2Hp9P9gMScDwtA==',key_name='tempest-keypair-1229377363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac7b6c7a58f842129f0f27294085214a',ramdisk_id='',reservation_id='r-l9bskaef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-793581715',owner_user_name='tempest-TaggedAttachmentsTest-793581715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f469ca83fe184f1698ed812016fb5b64',uuid=332796aa-adda-40ef-8650-126641e30821,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converting VIF {"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:77:3f,bridge_name='br-int',has_traffic_filtering=True,id=abb88c7a-347e-428e-8069-d2419ed701c3,network=Network(d457440c-d143-48a1-bb7c-231fad9d0448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb88c7a-34') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG os_vif [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:77:3f,bridge_name='br-int',has_traffic_filtering=True,id=abb88c7a-347e-428e-8069-d2419ed701c3,network=Network(d457440c-d143-48a1-bb7c-231fad9d0448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb88c7a-34') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9f91407-d377-555b-b452-9b71ab20ef06', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabb88c7a-34, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabb88c7a-34, col_values=(('qos', UUID('d2af3331-4d28-477a-86b1-1f2411b9695d')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabb88c7a-34, col_values=(('external_ids', {'iface-id': 'abb88c7a-347e-428e-8069-d2419ed701c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:77:3f', 'vm-uuid': '332796aa-adda-40ef-8650-126641e30821'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:05:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:46 user nova-compute[74540]: INFO os_vif [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:77:3f,bridge_name='br-int',has_traffic_filtering=True,id=abb88c7a-347e-428e-8069-d2419ed701c3,network=Network(d457440c-d143-48a1-bb7c-231fad9d0448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb88c7a-34')
Nov 07 04:05:47 user nova-compute[74540]: DEBUG nova.network.neutron [req-292ec687-f37c-428e-bfc1-429b5d693ace req-0b7a7a9d-314f-45b2-9ecf-51fea5a6264e service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updated VIF entry in instance network info cache for port 134a19cd-7f72-44e1-82c0-5ffab04d98b6. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:05:47 user nova-compute[74540]: DEBUG nova.network.neutron [req-292ec687-f37c-428e-bfc1-429b5d693ace req-0b7a7a9d-314f-45b2-9ecf-51fea5a6264e service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updating instance_info_cache with network_info: [{"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:05:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:05:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] No BDM found with device name hda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:05:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] No VIF found with MAC fa:16:3e:2e:77:3f, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:05:47 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Using config drive
Nov 07 04:05:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-292ec687-f37c-428e-bfc1-429b5d693ace req-0b7a7a9d-314f-45b2-9ecf-51fea5a6264e service nova] Releasing lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:05:47 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Creating config drive at /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk.config
Nov 07 04:05:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeh_bnp0y {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeh_bnp0y" returned: 0 in 0.078s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-48f9c2cd-41a8-4fea-909a-afa82c0bff92 req-7de31655-5e8d-4eb4-9897-bb3042194b06 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-changed-abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-48f9c2cd-41a8-4fea-909a-afa82c0bff92 req-7de31655-5e8d-4eb4-9897-bb3042194b06 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Refreshing instance network info cache due to event network-changed-abb88c7a-347e-428e-8069-d2419ed701c3. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:05:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-48f9c2cd-41a8-4fea-909a-afa82c0bff92 req-7de31655-5e8d-4eb4-9897-bb3042194b06 service nova] Acquiring lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:05:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-48f9c2cd-41a8-4fea-909a-afa82c0bff92 req-7de31655-5e8d-4eb4-9897-bb3042194b06 service nova] Acquired lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:05:48 user nova-compute[74540]: DEBUG nova.network.neutron [req-48f9c2cd-41a8-4fea-909a-afa82c0bff92 req-7de31655-5e8d-4eb4-9897-bb3042194b06 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Refreshing network info cache for port abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:05:48 user nova-compute[74540]: INFO nova.compute.manager [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] [instance: a3cae7a7-223c-438e-8206-39e0f1683cb0] Took 2.34 seconds to detach 1 volumes for instance.
Nov 07 04:05:48 user nova-compute[74540]: DEBUG nova.network.neutron [req-48f9c2cd-41a8-4fea-909a-afa82c0bff92 req-7de31655-5e8d-4eb4-9897-bb3042194b06 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Updated VIF entry in instance network info cache for port abb88c7a-347e-428e-8069-d2419ed701c3. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:05:48 user nova-compute[74540]: DEBUG nova.network.neutron [req-48f9c2cd-41a8-4fea-909a-afa82c0bff92 req-7de31655-5e8d-4eb4-9897-bb3042194b06 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Updating instance_info_cache with network_info: [{"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:05:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-48f9c2cd-41a8-4fea-909a-afa82c0bff92 req-7de31655-5e8d-4eb4-9897-bb3042194b06 service nova] Releasing lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:05:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:49 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:05:49 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:05:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:49 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Deleted allocations for instance a3cae7a7-223c-438e-8206-39e0f1683cb0
Nov 07 04:05:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-06376bd0-564e-42f1-b705-b460abdf04e8 tempest-ServerActionsTestOtherB-414073346 tempest-ServerActionsTestOtherB-414073346-project-member] Lock "a3cae7a7-223c-438e-8206-39e0f1683cb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.891s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-00cfac5d-13b0-4c9c-b69c-915e26c106b9 req-0416b2d2-bfb0-466a-820f-59811dd94eac service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-vif-plugged-abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-00cfac5d-13b0-4c9c-b69c-915e26c106b9 req-0416b2d2-bfb0-466a-820f-59811dd94eac service nova] Acquiring lock "332796aa-adda-40ef-8650-126641e30821-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-00cfac5d-13b0-4c9c-b69c-915e26c106b9 req-0416b2d2-bfb0-466a-820f-59811dd94eac service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-00cfac5d-13b0-4c9c-b69c-915e26c106b9 req-0416b2d2-bfb0-466a-820f-59811dd94eac service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-00cfac5d-13b0-4c9c-b69c-915e26c106b9 req-0416b2d2-bfb0-466a-820f-59811dd94eac service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] No waiting events found dispatching network-vif-plugged-abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:05:50 user nova-compute[74540]: WARNING nova.compute.manager [req-00cfac5d-13b0-4c9c-b69c-915e26c106b9 req-0416b2d2-bfb0-466a-820f-59811dd94eac service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received unexpected event network-vif-plugged-abb88c7a-347e-428e-8069-d2419ed701c3 for instance with vm_state building and task_state spawning.
Nov 07 04:05:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-00cfac5d-13b0-4c9c-b69c-915e26c106b9 req-0416b2d2-bfb0-466a-820f-59811dd94eac service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-vif-plugged-abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-00cfac5d-13b0-4c9c-b69c-915e26c106b9 req-0416b2d2-bfb0-466a-820f-59811dd94eac service nova] Acquiring lock "332796aa-adda-40ef-8650-126641e30821-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-00cfac5d-13b0-4c9c-b69c-915e26c106b9 req-0416b2d2-bfb0-466a-820f-59811dd94eac service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-00cfac5d-13b0-4c9c-b69c-915e26c106b9 req-0416b2d2-bfb0-466a-820f-59811dd94eac service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-00cfac5d-13b0-4c9c-b69c-915e26c106b9 req-0416b2d2-bfb0-466a-820f-59811dd94eac service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] No waiting events found dispatching network-vif-plugged-abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:05:50 user nova-compute[74540]: WARNING nova.compute.manager [req-00cfac5d-13b0-4c9c-b69c-915e26c106b9 req-0416b2d2-bfb0-466a-820f-59811dd94eac service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received unexpected event network-vif-plugged-abb88c7a-347e-428e-8069-d2419ed701c3 for instance with vm_state building and task_state spawning.
Nov 07 04:05:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.compute.manager [req-89d903e4-969b-4b8d-a604-214af7261ad9 req-8806d311-5ddc-4bfd-9150-331b393bcaad service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-changed-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.compute.manager [req-89d903e4-969b-4b8d-a604-214af7261ad9 req-8806d311-5ddc-4bfd-9150-331b393bcaad service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Refreshing instance network info cache due to event network-changed-4a999f3e-8cfa-4a58-871d-76baa2cec648. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-89d903e4-969b-4b8d-a604-214af7261ad9 req-8806d311-5ddc-4bfd-9150-331b393bcaad service nova] Acquiring lock "refresh_cache-45cf1e18-0792-451b-8022-000ba35ad605" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-89d903e4-969b-4b8d-a604-214af7261ad9 req-8806d311-5ddc-4bfd-9150-331b393bcaad service nova] Acquired lock "refresh_cache-45cf1e18-0792-451b-8022-000ba35ad605" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.network.neutron [req-89d903e4-969b-4b8d-a604-214af7261ad9 req-8806d311-5ddc-4bfd-9150-331b393bcaad service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Refreshing network info cache for port 4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:05:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 332796aa-adda-40ef-8650-126641e30821] Instance spawned successfully.
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.network.neutron [req-89d903e4-969b-4b8d-a604-214af7261ad9 req-8806d311-5ddc-4bfd-9150-331b393bcaad service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Updated VIF entry in instance network info cache for port 4a999f3e-8cfa-4a58-871d-76baa2cec648. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.network.neutron [req-89d903e4-969b-4b8d-a604-214af7261ad9 req-8806d311-5ddc-4bfd-9150-331b393bcaad service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Updating instance_info_cache with network_info: [{"id": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "address": "fa:16:3e:a5:ae:91", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a999f3e-8c", "ovs_interfaceid": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-89d903e4-969b-4b8d-a604-214af7261ad9 req-8806d311-5ddc-4bfd-9150-331b393bcaad service nova] Releasing lock "refresh_cache-45cf1e18-0792-451b-8022-000ba35ad605" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:05:51 user nova-compute[74540]: INFO nova.compute.manager [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Took 6.77 seconds to spawn the instance on the hypervisor.
Nov 07 04:05:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:05:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:51 user nova-compute[74540]: INFO nova.compute.manager [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Took 7.76 seconds to build instance.
Nov 07 04:05:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a2d87ddf-bd1d-4228-9ec9-45d5bec23b07 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "332796aa-adda-40ef-8650-126641e30821" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.890s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG nova.objects.instance [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:54 user nova-compute[74540]: INFO nova.compute.manager [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Attaching volume c3225410-ef51-46ce-b9a3-2cdd6e153598 to /dev/vdb
Nov 07 04:05:54 user nova-compute[74540]: DEBUG os_brick.utils [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[908aa11c-0cc2-409a-9709-59fd19cd50b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64e78b7-b1f9-4051-be8d-6e0abed08490]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6b312a-ab75-4479-bfda-d63c4ad80948]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe57611-5384-466b-acbe-74c3c9ce5e3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:05:54 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:05:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54eff18-c61b-4bec-9d17-5e9f21710694]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG os_brick.utils [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:05:54 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updating existing volume attachment record: 43aa6e6d-7036-4e13-b952-0a05429867e3 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:05:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "45cf1e18-0792-451b-8022-000ba35ad605" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'flavor' on Instance uuid 45cf1e18-0792-451b-8022-000ba35ad605 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "45cf1e18-0792-451b-8022-000ba35ad605" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "45cf1e18-0792-451b-8022-000ba35ad605" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:05:58 user nova-compute[74540]: INFO nova.compute.manager [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Attaching volume 1a1c6c3a-b4f1-4014-9ef2-4df12b652099 to /dev/vdb
Nov 07 04:05:58 user nova-compute[74540]: DEBUG os_brick.utils [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[db99b2fa-e7eb-4503-977a-1bd4ab723db9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[90addd24-ec6c-4c2d-8d19-6f061b51606b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e73eb6-4676-4d5e-820c-9c5a098da556]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[791a6fac-2643-4a00-9c3b-2c6b574c578d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:05:58 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:05:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1105bac4-de73-4312-9d4b-5dfd83e76d26]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG os_brick.utils [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:05:58 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Updating existing volume attachment record: d930de6d-401d-45c0-9cc0-080f4299622d {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:06:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:06:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sblqKIDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:06:16 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:06:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:06:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:06:16 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:06:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:06:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:06:16 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:06:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb76a79-71ad-4e7e-9443-09138eaaad65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:06:16 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7553986-d01e-441b-87be-7130100c17bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598] added
Nov 07 04:06:17 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1959311d-978c-4bda-91b7-12ac675c52f1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b067ee7d-1ebc-410c-9edd-8af2058cdc7b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sblqKIDa {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sblqKIDa" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afbc8b1-c3f0-4974-b323-9e95cc1d04a1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sblqKIDa'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eb08d1-74c6-45c3-a23e-2543623fc392]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[276de16b-77c5-46c6-bddb-436aedc44ccb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:06:17 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:06:17 user nova-compute[74540]:  {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:06:17 user nova-compute[74540]: WARNING os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 04:06:17 user nova-compute[74540]: 
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e106fb-8a46-4755-820e-947c247b8988]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260]
Nov 07 04:06:17 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260] successful.
Nov 07 04:06:17 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fc62ba-dd21-4b23-ae28-b6ce586682a7]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[db41c90f-4d9b-4176-b85c-d96f1380f9ea]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:17 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:17 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[22308e6d-0f8d-4778-bdad-1fb515c2ce69]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:06:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:06:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sblqKIDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:06:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:06:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23036636237623738', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:06:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036636237623738', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:06:18 user nova-compute[74540]: DEBUG nova.objects.instance [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:06:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:06:18 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:06:18 user nova-compute[74540]:   <source dev="/dev/sdb"/>
Nov 07 04:06:18 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:06:18 user nova-compute[74540]:   <serial>c3225410-ef51-46ce-b9a3-2cdd6e153598</serial>
Nov 07 04:06:18 user nova-compute[74540]: </disk>
Nov 07 04:06:18 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:06:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:06:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:06:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No VIF found with MAC fa:16:3e:53:d9:ef, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:06:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-82f5a641-4e28-4dc4-87c4-4288d0bdb31f tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.476s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5ca126bb-b8ba-4d47-abd9-0d775e41c2bb tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5ca126bb-b8ba-4d47-abd9-0d775e41c2bb tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5ca126bb-b8ba-4d47-abd9-0d775e41c2bb tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5ca126bb-b8ba-4d47-abd9-0d775e41c2bb tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74540) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG nova.objects.instance [None req-5ca126bb-b8ba-4d47-abd9-0d775e41c2bb tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-949f1eac-4828-48fc-a0f3-6574d19fb0ff req-78dcf83a-f95c-4f0e-bc94-98d407769bbb service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-unplugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-949f1eac-4828-48fc-a0f3-6574d19fb0ff req-78dcf83a-f95c-4f0e-bc94-98d407769bbb service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-949f1eac-4828-48fc-a0f3-6574d19fb0ff req-78dcf83a-f95c-4f0e-bc94-98d407769bbb service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-949f1eac-4828-48fc-a0f3-6574d19fb0ff req-78dcf83a-f95c-4f0e-bc94-98d407769bbb service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-949f1eac-4828-48fc-a0f3-6574d19fb0ff req-78dcf83a-f95c-4f0e-bc94-98d407769bbb service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-unplugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:06:19 user nova-compute[74540]: WARNING nova.compute.manager [req-949f1eac-4828-48fc-a0f3-6574d19fb0ff req-78dcf83a-f95c-4f0e-bc94-98d407769bbb service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-unplugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state active and task_state powering-off.
Nov 07 04:06:20 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance destroyed successfully.
Nov 07 04:06:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5ca126bb-b8ba-4d47-abd9-0d775e41c2bb tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:06:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5ca126bb-b8ba-4d47-abd9-0d775e41c2bb tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.868s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMOQLqKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:06:21 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:06:21 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:06:21 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9e42a1-d974-4ba1-8bdc-fe2c728d86f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:06:21 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[47163036-c91e-4cc3-a57f-d35600e29296]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099] added
Nov 07 04:06:21 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2125cef0-b96b-4cb2-a48b-937b17d03824]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[80eba2ed-32dd-4cd4-9287-b3ee0389906c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMOQLqKU {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMOQLqKU" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ac880-1634-497d-8aa6-9410df2ceef4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TMOQLqKU'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6d0960-72e9-468d-9943-9a092a1104fe]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[920203bb-ab95-4342-b207-4f8a17de1da2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:21 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:21 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ad1dc2-3ed3-4395-8183-9f359f3ec170]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099, portal: 172.16.0.220,3260]
Nov 07 04:06:21 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099, portal: 172.16.0.220,3260] successful.
Nov 07 04:06:21 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e230031a-67fb-4a8a-8005-abc7af795cad]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98c7f64-d061-4fb3-93b5-bc42db6a9d1f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:21 user nova-compute[74540]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)
Nov 07 04:06:21 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:21 user nova-compute[74540]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)
Nov 07 04:06:21 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b75cba-3734-4c32-b2cf-55adb47ab8a2]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMOQLqKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-6edbce86-ca3d-4d97-a06e-5e620a4f5a0c req-fd1e1077-8fef-4e47-9bb5-f54f6b339c46 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6edbce86-ca3d-4d97-a06e-5e620a4f5a0c req-fd1e1077-8fef-4e47-9bb5-f54f6b339c46 service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6edbce86-ca3d-4d97-a06e-5e620a4f5a0c req-fd1e1077-8fef-4e47-9bb5-f54f6b339c46 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6edbce86-ca3d-4d97-a06e-5e620a4f5a0c req-fd1e1077-8fef-4e47-9bb5-f54f6b339c46 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-6edbce86-ca3d-4d97-a06e-5e620a4f5a0c req-fd1e1077-8fef-4e47-9bb5-f54f6b339c46 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:06:21 user nova-compute[74540]: WARNING nova.compute.manager [req-6edbce86-ca3d-4d97-a06e-5e620a4f5a0c req-fd1e1077-8fef-4e47-9bb5-f54f6b339c46 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state stopped and task_state None.
Nov 07 04:06:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:06:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26566323130366263', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:06:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566323130366263', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:06:22 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'flavor' on Instance uuid 45cf1e18-0792-451b-8022-000ba35ad605 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:06:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:06:22 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:06:22 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:06:22 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:06:22 user nova-compute[74540]:   <serial>1a1c6c3a-b4f1-4014-9ef2-4df12b652099</serial>
Nov 07 04:06:22 user nova-compute[74540]: </disk>
Nov 07 04:06:22 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:06:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:06:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:06:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No VIF found with MAC fa:16:3e:a5:ae:91, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:06:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4ea4526c-299e-4fd6-a472-5abcc13b6df2 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "45cf1e18-0792-451b-8022-000ba35ad605" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.450s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "45cf1e18-0792-451b-8022-000ba35ad605" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:24 user nova-compute[74540]: INFO nova.compute.manager [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Detaching volume 1a1c6c3a-b4f1-4014-9ef2-4df12b652099
Nov 07 04:06:24 user nova-compute[74540]: INFO nova.virt.block_device [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Attempting to driver detach volume 1a1c6c3a-b4f1-4014-9ef2-4df12b652099 from mountpoint /dev/vdb
Nov 07 04:06:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Attempting to detach device vdb from instance 45cf1e18-0792-451b-8022-000ba35ad605 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:06:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:06:24 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:06:24 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:06:24 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:06:24 user nova-compute[74540]:   <serial>1a1c6c3a-b4f1-4014-9ef2-4df12b652099</serial>
Nov 07 04:06:24 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:06:24 user nova-compute[74540]: </disk>
Nov 07 04:06:24 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:06:24 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully detached device vdb from instance 45cf1e18-0792-451b-8022-000ba35ad605 from the persistent domain config.
Nov 07 04:06:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45cf1e18-0792-451b-8022-000ba35ad605 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:06:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:06:24 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:06:24 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:06:24 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:06:24 user nova-compute[74540]:   <serial>1a1c6c3a-b4f1-4014-9ef2-4df12b652099</serial>
Nov 07 04:06:24 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:06:24 user nova-compute[74540]: </disk>
Nov 07 04:06:24 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:06:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45cf1e18-0792-451b-8022-000ba35ad605 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:06:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:06:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:32 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:06:33 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:06:36 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:06:36 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:06:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgMFODqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:06:37 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:06:37 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:06:37 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d43cef-a689-4b81-80c4-80602ab3d67b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:06:37 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ca191b-69d3-4547-948a-f28c2d99bcbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8] added
Nov 07 04:06:37 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12f5ef8-a2a2-49db-b83e-8d7c2563c47a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2d41a9-e879-479e-8795-c33f24f677f1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wgMFODqj {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wgMFODqj" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a93450-3a29-4774-a529-8a19af2b052f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wgMFODqj'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f9d562-6e1e-40f3-8cff-a9aa21acb620]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3372240-f938-49cb-93e9-7882158016bc]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:37 user nova-compute[74540]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)
Nov 07 04:06:37 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:37 user nova-compute[74540]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)
Nov 07 04:06:37 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a34504-689e-4497-8dfc-57802995e9e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8, portal: 172.16.0.220,3260]
Nov 07 04:06:37 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8, portal: 172.16.0.220,3260] successful.
Nov 07 04:06:37 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dea88d-ca00-464e-864a-767940d009ee]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c503a76-91d1-4ffa-b05a-94122abe3981]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:37 user nova-compute[74540]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)
Nov 07 04:06:37 user nova-compute[74540]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 (non-flash)
Nov 07 04:06:37 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:37 user nova-compute[74540]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)
Nov 07 04:06:37 user nova-compute[74540]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 (non-flash)
Nov 07 04:06:37 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd783bcf-8860-455d-a490-47f94d49fed2]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:06:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgMFODqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26464383639656132', 'path': '/dev/sdd'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464383639656132', 'path': '/dev/sdd'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG nova.objects.instance [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lazy-loading 'flavor' on Instance uuid 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:06:38 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:06:38 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:06:38 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:06:38 user nova-compute[74540]:   <serial>56403c09-1336-4c5f-83d3-aa4b6092b2c8</serial>
Nov 07 04:06:38 user nova-compute[74540]: </disk>
Nov 07 04:06:38 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] No VIF found with MAC fa:16:3e:cd:03:04, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-16054fae-5b28-41a0-bc85-72ec3e26d5fa tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 58.367s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:39 user nova-compute[74540]: INFO nova.compute.manager [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Terminating instance
Nov 07 04:06:39 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-5b2bb362-c838-4fa0-9b91-2d07d91a1533 req-33a9a277-723e-4683-a4d9-d3e9edc0eda2 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Received event network-vif-unplugged-eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5b2bb362-c838-4fa0-9b91-2d07d91a1533 req-33a9a277-723e-4683-a4d9-d3e9edc0eda2 service nova] Acquiring lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5b2bb362-c838-4fa0-9b91-2d07d91a1533 req-33a9a277-723e-4683-a4d9-d3e9edc0eda2 service nova] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5b2bb362-c838-4fa0-9b91-2d07d91a1533 req-33a9a277-723e-4683-a4d9-d3e9edc0eda2 service nova] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-5b2bb362-c838-4fa0-9b91-2d07d91a1533 req-33a9a277-723e-4683-a4d9-d3e9edc0eda2 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] No waiting events found dispatching network-vif-unplugged-eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-5b2bb362-c838-4fa0-9b91-2d07d91a1533 req-33a9a277-723e-4683-a4d9-d3e9edc0eda2 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Received event network-vif-unplugged-eca23c6c-b0d5-4298-9b3f-ba330e542d3d for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:40 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Instance destroyed successfully.
Nov 07 04:06:40 user nova-compute[74540]: DEBUG nova.objects.instance [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lazy-loading 'resources' on Instance uuid 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-760344290',display_name='tempest-DeleteServersTestJSON-server-760344290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-760344290',id=17,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:03:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb763f6ff9544764b4b951b06ae0a800',ramdisk_id='',reservation_id='r-agx25kyj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-134629333',owner_user_name='tempest-DeleteServersTestJSON-134629333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:03:52Z,user_data=None,user_id='4a7b1d7f7d954f9ab69427da7d64d707',uuid=33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "address": "fa:16:3e:cd:03:04", "network": {"id": "8fb8eb25-9c97-44be-a686-8a000dd45f55", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1770044310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb763f6ff9544764b4b951b06ae0a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca23c6c-b0", "ovs_interfaceid": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Converting VIF {"id": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "address": "fa:16:3e:cd:03:04", "network": {"id": "8fb8eb25-9c97-44be-a686-8a000dd45f55", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1770044310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb763f6ff9544764b4b951b06ae0a800", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeca23c6c-b0", "ovs_interfaceid": "eca23c6c-b0d5-4298-9b3f-ba330e542d3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:03:04,bridge_name='br-int',has_traffic_filtering=True,id=eca23c6c-b0d5-4298-9b3f-ba330e542d3d,network=Network(8fb8eb25-9c97-44be-a686-8a000dd45f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca23c6c-b0') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_vif [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:03:04,bridge_name='br-int',has_traffic_filtering=True,id=eca23c6c-b0d5-4298-9b3f-ba330e542d3d,network=Network(8fb8eb25-9c97-44be-a686-8a000dd45f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca23c6c-b0') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeca23c6c-b0, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff27b376-dd55-40bf-b80a-efb19b67f5eb) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:40 user nova-compute[74540]: INFO os_vif [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:03:04,bridge_name='br-int',has_traffic_filtering=True,id=eca23c6c-b0d5-4298-9b3f-ba330e542d3d,network=Network(8fb8eb25-9c97-44be-a686-8a000dd45f55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeca23c6c-b0')
Nov 07 04:06:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgMFODqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:06:40 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:40 user nova-compute[74540]: INFO nova.compute.manager [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Unshelving
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06b8d3e-2e16-48e5-9f86-b1c411256e9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:06:40 user nova-compute[74540]: No targets found.
Nov 07 04:06:40 user nova-compute[74540]: iSNS:
Nov 07 04:06:40 user nova-compute[74540]: No targets found.
Nov 07 04:06:40 user nova-compute[74540]: STATIC:
Nov 07 04:06:40 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598
Nov 07 04:06:40 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:06:40 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:06:40 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8
Nov 07 04:06:40 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:06:40 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:06:40 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099
Nov 07 04:06:40 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:06:40 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:06:40 user nova-compute[74540]: FIRMWARE:
Nov 07 04:06:40 user nova-compute[74540]: No targets found.
Nov 07 04:06:40 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:06:40 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:06:40 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1798d38a-7ab8-4a1f-a217-5c4782eb1ff5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf1bd1a-9abf-4303-8481-f277ebde182b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:40 user nova-compute[74540]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)
Nov 07 04:06:40 user nova-compute[74540]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 (non-flash)
Nov 07 04:06:40 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:40 user nova-compute[74540]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)
Nov 07 04:06:40 user nova-compute[74540]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 (non-flash)
Nov 07 04:06:40 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee143afc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8'): ({'sdd'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Removing single pathed devices sdd {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c395a2-863c-44a8-aa54-0f98dc1a60e5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b89ea73-2a01-4664-9661-f8738f2e7416]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Flushing IO for device /dev/sdd {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dc981e-983a-41af-9808-d83deaf08334]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:41 user nova-compute[74540]: INFO nova.virt.block_device [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Booting with volume 5b341039-9c2b-41c2-8276-0b304d2bbb5c at /dev/vdc
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfeae1c-698a-491e-a1dc-79f7bf734ead]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[721e3325-12e9-4b10-af5b-699eec502dfb]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.utils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22ce9c4-6f2a-4d43-bcf8-4f2dee2bb6c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfd46fd-176f-4e00-bf76-6b228ab679d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6500d5d-3adc-4521-b86b-4dced8b4735d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8, portal: 172.16.0.220,3260]
Nov 07 04:06:41 user nova-compute[74540]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8, portal: 172.16.0.220,3260] successful.
Nov 07 04:06:41 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af2db06-0812-4c48-b644-d3201cac0f76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edc96b2-cccb-4bff-9362-c90cb6c28139]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56403c09-1336-4c5f-83d3-aa4b6092b2c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed60c98-eaaf-4663-9da4-fb44a4ee3cf4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] <== disconnect_volume: return (426ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:06:41 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Deleting instance files /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d_del
Nov 07 04:06:41 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Deletion of /opt/stack/data/nova/instances/33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d_del complete
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:06:41 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[196449fc-731d-4895-97e9-42979f655050]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG os_brick.utils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updating existing volume attachment record: 00734cb6-bc46-44d2-98f8-0fde7a6dd536 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: INFO nova.compute.manager [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-bb7fd87b-ab08-4e26-8148-b3b22daa56b2 req-be4dc319-2fef-4623-a3d7-66bbc6759995 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Received event network-vif-deleted-eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:06:41 user nova-compute[74540]: INFO nova.compute.manager [req-bb7fd87b-ab08-4e26-8148-b3b22daa56b2 req-be4dc319-2fef-4623-a3d7-66bbc6759995 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Neutron deleted interface eca23c6c-b0d5-4298-9b3f-ba330e542d3d; detaching it from the instance and deleting it from the info cache
Nov 07 04:06:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-bb7fd87b-ab08-4e26-8148-b3b22daa56b2 req-be4dc319-2fef-4623-a3d7-66bbc6759995 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:06:41 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Took 0.53 seconds to deallocate network for instance.
Nov 07 04:06:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-bb7fd87b-ab08-4e26-8148-b3b22daa56b2 req-be4dc319-2fef-4623-a3d7-66bbc6759995 service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Detach interface failed, port_id=eca23c6c-b0d5-4298-9b3f-ba330e542d3d, reason: Instance 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.manager [req-0f916088-a8a7-44a5-963d-938030ab4b5a req-32744c20-05ec-4019-b8e1-b4ad87e54cac service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Received event network-vif-plugged-eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0f916088-a8a7-44a5-963d-938030ab4b5a req-32744c20-05ec-4019-b8e1-b4ad87e54cac service nova] Acquiring lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0f916088-a8a7-44a5-963d-938030ab4b5a req-32744c20-05ec-4019-b8e1-b4ad87e54cac service nova] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0f916088-a8a7-44a5-963d-938030ab4b5a req-32744c20-05ec-4019-b8e1-b4ad87e54cac service nova] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.manager [req-0f916088-a8a7-44a5-963d-938030ab4b5a req-32744c20-05ec-4019-b8e1-b4ad87e54cac service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] No waiting events found dispatching network-vif-plugged-eca23c6c-b0d5-4298-9b3f-ba330e542d3d {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:06:42 user nova-compute[74540]: WARNING nova.compute.manager [req-0f916088-a8a7-44a5-963d-938030ab4b5a req-32744c20-05ec-4019-b8e1-b4ad87e54cac service nova] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Received unexpected event network-vif-plugged-eca23c6c-b0d5-4298-9b3f-ba330e542d3d for instance with vm_state active and task_state deleting.
Nov 07 04:06:42 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:06:42 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7662MB free_disk=25.12936019897461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:42 user nova-compute[74540]: INFO nova.compute.manager [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] [instance: 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d] Took 0.96 seconds to detach 1 volumes for instance.
Nov 07 04:06:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance fab159b1-8768-4266-9a2f-3983628aeb86 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 45cf1e18-0792-451b-8022-000ba35ad605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d61ec49c-3345-4808-bfcd-a9d925fe1918 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 332796aa-adda-40ef-8650-126641e30821 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6b84cdaa-6964-4e16-95b3-accb9086d871 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:06:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:06:43 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:06:43 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:06:43 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:06:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.527s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:43 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:06:43 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:06:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:43 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Deleted allocations for instance 33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d
Nov 07 04:06:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd8007fd-dd77-45ef-94b1-c359a9dc7744 tempest-DeleteServersTestJSON-134629333 tempest-DeleteServersTestJSON-134629333-project-member] Lock "33fdf7e2-bdaf-43c4-a64c-3cb44052cd9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.103s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:06:44 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45cf1e18-0792-451b-8022-000ba35ad605 is timed out.
Nov 07 04:06:44 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully detached device vdb from instance 45cf1e18-0792-451b-8022-000ba35ad605 from the live domain config.
Nov 07 04:06:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMOQLqKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:06:44 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0a0170-7ea4-427c-ae77-3f30ac3e5871]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:06:44 user nova-compute[74540]: No targets found.
Nov 07 04:06:44 user nova-compute[74540]: iSNS:
Nov 07 04:06:44 user nova-compute[74540]: No targets found.
Nov 07 04:06:44 user nova-compute[74540]: STATIC:
Nov 07 04:06:44 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598
Nov 07 04:06:44 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:06:44 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:06:44 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099
Nov 07 04:06:44 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:06:44 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:06:44 user nova-compute[74540]: FIRMWARE:
Nov 07 04:06:44 user nova-compute[74540]: No targets found.
Nov 07 04:06:44 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:06:44 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:06:44 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0267f02-77c5-4849-bb75-6954fd8306d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f16a4f-d130-4e7b-a01f-06e92e454018]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:44 user nova-compute[74540]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)
Nov 07 04:06:44 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:44 user nova-compute[74540]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 (non-flash)
Nov 07 04:06:44 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc3f5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae6dd60-3915-4ef8-ad35-6e257d14bb44]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1af280-772d-4f16-a1f4-a5dcbe9e03a5]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc78b25-c2ec-4972-9117-8e6a3846f62e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.078s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60d0b56-1758-478f-9b67-4e6a7abcfc12]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b137fac-4e38-44da-878f-a5bdad99bc04]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e44706-b425-4382-8e67-1a30a3aae0a6]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099, portal: 172.16.0.220,3260]
Nov 07 04:06:44 user nova-compute[74540]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099, portal: 172.16.0.220,3260] successful.
Nov 07 04:06:44 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a1c6c3a-b4f1-4014-9ef2-4df12b652099 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:45 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7833509-a97e-466c-be30-96f6acbe8740]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:06:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:06:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] <== disconnect_volume: return (370ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:06:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:06:45 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updating instance_info_cache with network_info: [{"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:06:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:06:45 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:06:45 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:06:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:46 user nova-compute[74540]: DEBUG nova.objects.instance [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'flavor' on Instance uuid 45cf1e18-0792-451b-8022-000ba35ad605 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:06:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-77001804-c8a1-4fe0-a28e-31f6c74b1796 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "45cf1e18-0792-451b-8022-000ba35ad605" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.056s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:06:51 user nova-compute[74540]: INFO nova.compute.manager [None req-392be17a-b0de-40ac-94cd-7f19547c71d0 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Get console output
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "fab159b1-8768-4266-9a2f-3983628aeb86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "fab159b1-8768-4266-9a2f-3983628aeb86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "fab159b1-8768-4266-9a2f-3983628aeb86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Events pending at deletion: volume-reimaged-9edaab1d-3869-4da4-81e8-39c0bd9687a1 {{(pid=74540) _delete_instance /opt/stack/nova/nova/compute/manager.py:3257}}
Nov 07 04:06:51 user nova-compute[74540]: INFO nova.compute.manager [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Terminating instance
Nov 07 04:06:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [-] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] During wait destroy, instance disappeared. {{(pid=74540) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Nov 07 04:06:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Instance destroyed successfully.
Nov 07 04:06:51 user nova-compute[74540]: DEBUG nova.objects.instance [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lazy-loading 'resources' on Instance uuid fab159b1-8768-4266-9a2f-3983628aeb86 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T03:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-44869406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-61761870',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPey593voBblcXjUX6Rj4hYhQPXoWv5V3hZq/5nyg3saBjuq6wINCmOescCqsyejhlbUtRTx0iTq9cl/OfUi4sD2g9/3+n6UDIpNBD8OFscEKTzQMZbZpWSKD/LM735sYw==',key_name='tempest-keypair-1948852252',keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:58:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='fb1ae9772ccb4183b607084edfb8c314',ramdisk_id='',reservation_id='r-bd4tsznq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1901483781',owner_user_name='tempest-ServerActionsV293TestJSON-1901483781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aebf4eecd5445e3a118203654ae2dbe',uuid=fab159b1-8768-4266-9a2f-3983628aeb86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Converting VIF {"id": "8689cc10-30f0-488d-abae-c8edc08c9750", "address": "fa:16:3e:f5:c3:47", "network": {"id": "fe9b8c07-cd79-4cc9-9261-16946a99ce2c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-406663676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1ae9772ccb4183b607084edfb8c314", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8689cc10-30", "ovs_interfaceid": "8689cc10-30f0-488d-abae-c8edc08c9750", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:47,bridge_name='br-int',has_traffic_filtering=True,id=8689cc10-30f0-488d-abae-c8edc08c9750,network=Network(fe9b8c07-cd79-4cc9-9261-16946a99ce2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8689cc10-30') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_vif [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:47,bridge_name='br-int',has_traffic_filtering=True,id=8689cc10-30f0-488d-abae-c8edc08c9750,network=Network(fe9b8c07-cd79-4cc9-9261-16946a99ce2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8689cc10-30') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8689cc10-30, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:06:51 user nova-compute[74540]: INFO os_vif [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:c3:47,bridge_name='br-int',has_traffic_filtering=True,id=8689cc10-30f0-488d-abae-c8edc08c9750,network=Network(fe9b8c07-cd79-4cc9-9261-16946a99ce2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8689cc10-30')
Nov 07 04:06:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtdpoZls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:06:51 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81675cb-31e0-4b1a-9bdf-0422fb1338b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:06:51 user nova-compute[74540]: No targets found.
Nov 07 04:06:51 user nova-compute[74540]: iSNS:
Nov 07 04:06:51 user nova-compute[74540]: No targets found.
Nov 07 04:06:51 user nova-compute[74540]: STATIC:
Nov 07 04:06:51 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598
Nov 07 04:06:51 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:06:51 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:06:51 user nova-compute[74540]: FIRMWARE:
Nov 07 04:06:51 user nova-compute[74540]: No targets found.
Nov 07 04:06:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:06:51 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:06:51 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9edaab1d-3869-4da4-81e8-39c0bd9687a1', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b2f28c-6e68-410d-85e3-393ec7dbc64e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c7ec41-d920-474f-bc29-6b87e4e34d8f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:06:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee143ac940>, {}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Disconnecting from: [] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] <== disconnect_volume: return (69ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:06:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Deletion of /opt/stack/data/nova/instances/fab159b1-8768-4266-9a2f-3983628aeb86_del complete
Nov 07 04:06:51 user nova-compute[74540]: INFO nova.compute.manager [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Took 0.18 seconds to destroy the instance on the hypervisor.
Nov 07 04:06:51 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:06:51 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:06:52 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:06:52 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Took 0.72 seconds to deallocate network for instance.
Nov 07 04:06:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-4812efd0-4140-4606-808e-0e6494121085 req-dbf6ef41-bff2-429f-850a-6cf707346510 service nova] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Received event network-vif-deleted-8689cc10-30f0-488d-abae-c8edc08c9750 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:06:52 user nova-compute[74540]: INFO nova.compute.manager [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Took 0.08 seconds to detach 1 volumes for instance.
Nov 07 04:06:52 user nova-compute[74540]: DEBUG nova.compute.manager [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] [instance: fab159b1-8768-4266-9a2f-3983628aeb86] Deleting volume: 9edaab1d-3869-4da4-81e8-39c0bd9687a1 {{(pid=74540) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 07 04:06:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:06:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:06:52 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:06:52 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:06:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:52 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Deleted allocations for instance fab159b1-8768-4266-9a2f-3983628aeb86
Nov 07 04:06:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-116e1403-9f31-4b20-9a65-2cb4d4321600 tempest-ServerActionsV293TestJSON-1901483781 tempest-ServerActionsV293TestJSON-1901483781-project-member] Lock "fab159b1-8768-4266-9a2f-3983628aeb86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.549s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:06:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4340-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:06:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:07:06 user nova-compute[74540]: INFO nova.compute.claims [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Claim successful on node user
Nov 07 04:07:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-4d165a50-435a-4d8d-b632-32d0224e0cbd req-ff595230-e8d0-4c4e-a618-5ba7631d742e service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-changed-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-4d165a50-435a-4d8d-b632-32d0224e0cbd req-ff595230-e8d0-4c4e-a618-5ba7631d742e service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Refreshing instance network info cache due to event network-changed-82decd3b-b1ba-4b4c-88ab-fbae31e34394. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4d165a50-435a-4d8d-b632-32d0224e0cbd req-ff595230-e8d0-4c4e-a618-5ba7631d742e service nova] Acquiring lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4d165a50-435a-4d8d-b632-32d0224e0cbd req-ff595230-e8d0-4c4e-a618-5ba7631d742e service nova] Acquired lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG nova.network.neutron [req-4d165a50-435a-4d8d-b632-32d0224e0cbd req-ff595230-e8d0-4c4e-a618-5ba7631d742e service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Refreshing network info cache for port 82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:07:06 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:07:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:07:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG nova.policy [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99ba0f9acca84cdb8cf90c4b313e1b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438cd05cbdb34608940422562ba150c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'flavor' on Instance uuid d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:07:07 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Creating image(s)
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "/opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "/opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG nova.network.neutron [req-4d165a50-435a-4d8d-b632-32d0224e0cbd req-ff595230-e8d0-4c4e-a618-5ba7631d742e service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updated VIF entry in instance network info cache for port 82decd3b-b1ba-4b4c-88ab-fbae31e34394. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG nova.network.neutron [req-4d165a50-435a-4d8d-b632-32d0224e0cbd req-ff595230-e8d0-4c4e-a618-5ba7631d742e service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updating instance_info_cache with network_info: [{"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:07 user nova-compute[74540]: INFO nova.compute.manager [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Attaching volume 485b0b7f-affb-4576-beb6-807efcbe5c0a to /dev/vdb
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4d165a50-435a-4d8d-b632-32d0224e0cbd req-ff595230-e8d0-4c4e-a618-5ba7631d742e service nova] Releasing lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG os_brick.utils [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[463571ff-e6cb-4d3d-90d4-dff2ea498692]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c17c28c-8c1c-4d97-aaa3-e91c6f0ff47f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcc6a52-7521-49dc-8350-131cffd7405f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bafc03f-af79-4924-aef5-ef1fd3127d50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk 1073741824" returned: 0 in 0.090s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:07:07 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[548fe054-3683-4946-8674-c314c409cf41]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG os_brick.utils [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updating existing volume attachment record: 6d66edb2-cf06-4301-b633-9d9e7f008fae {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Cannot resize image /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Ensure instance console log exists: /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Successfully created port: a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-e1cf5860-442c-4add-8122-f1be9114423b req-c7d6ab9a-61f5-499c-a265-6d57caad3dd2 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received event network-changed-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-e1cf5860-442c-4add-8122-f1be9114423b req-c7d6ab9a-61f5-499c-a265-6d57caad3dd2 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Refreshing instance network info cache due to event network-changed-32b18c39-92d0-488b-891e-fd7b5f9b85d1. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e1cf5860-442c-4add-8122-f1be9114423b req-c7d6ab9a-61f5-499c-a265-6d57caad3dd2 service nova] Acquiring lock "refresh_cache-74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e1cf5860-442c-4add-8122-f1be9114423b req-c7d6ab9a-61f5-499c-a265-6d57caad3dd2 service nova] Acquired lock "refresh_cache-74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG nova.network.neutron [req-e1cf5860-442c-4add-8122-f1be9114423b req-c7d6ab9a-61f5-499c-a265-6d57caad3dd2 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Refreshing network info cache for port 32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG nova.network.neutron [req-e1cf5860-442c-4add-8122-f1be9114423b req-c7d6ab9a-61f5-499c-a265-6d57caad3dd2 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Updated VIF entry in instance network info cache for port 32b18c39-92d0-488b-891e-fd7b5f9b85d1. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG nova.network.neutron [req-e1cf5860-442c-4add-8122-f1be9114423b req-c7d6ab9a-61f5-499c-a265-6d57caad3dd2 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Updating instance_info_cache with network_info: [{"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e1cf5860-442c-4add-8122-f1be9114423b req-c7d6ab9a-61f5-499c-a265-6d57caad3dd2 service nova] Releasing lock "refresh_cache-74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG nova.objects.instance [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lazy-loading 'flavor' on Instance uuid 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Successfully updated port: a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquired lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:07:08 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:09 user nova-compute[74540]: INFO nova.compute.manager [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Attaching volume b195147d-b815-42ae-86a8-6a05a4936814 to /dev/vdb
Nov 07 04:07:09 user nova-compute[74540]: DEBUG os_brick.utils [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1f0a75-f2d1-4b68-a44c-0ca9206eee8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a082274-0632-4eee-bbd1-a5bf3c4b49dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8df946-9e3e-49fd-a3d2-5ba390bed537]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63340a6-cf0d-453d-9759-7f0b7e9311e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updating instance_info_cache with network_info: [{"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:07:09 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d216bec-899d-4016-9535-d4c9d314a4fa]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG os_brick.utils [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Updating existing volume attachment record: 92b8951d-c381-44a4-9deb-b42d905d3e5f {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Releasing lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Instance network_info: |[{"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Start _get_guest_xml network_info=[{"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:07:09 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:07:09 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-767517572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-767517572',id=23,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-a9gdx7mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:07:07Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=bb6c2f59-c949-4df8-a6e4-ed92d7926639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=a666b729-73b7-4953-871d-fa236a4dd3f0,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa666b729-73') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'pci_devices' on Instance uuid bb6c2f59-c949-4df8-a6e4-ed92d7926639 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:07:09 user nova-compute[74540]:   <uuid>bb6c2f59-c949-4df8-a6e4-ed92d7926639</uuid>
Nov 07 04:07:09 user nova-compute[74540]:   <name>instance-00000017</name>
Nov 07 04:07:09 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:07:09 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:07:09 user nova-compute[74540]:   <metadata>
Nov 07 04:07:09 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:07:09 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:07:09 user nova-compute[74540]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-767517572</nova:name>
Nov 07 04:07:09 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:07:09</nova:creationTime>
Nov 07 04:07:09 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:07:09 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:07:09 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:07:09 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:07:09 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:07:09 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:07:09 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:07:09 user nova-compute[74540]:       <nova:owner>
Nov 07 04:07:09 user nova-compute[74540]:         <nova:user uuid="99ba0f9acca84cdb8cf90c4b313e1b7c">tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member</nova:user>
Nov 07 04:07:09 user nova-compute[74540]:         <nova:project uuid="438cd05cbdb34608940422562ba150c8">tempest-ServerBootFromVolumeStableRescueTest-1329597446</nova:project>
Nov 07 04:07:09 user nova-compute[74540]:       </nova:owner>
Nov 07 04:07:09 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:07:09 user nova-compute[74540]:       <nova:ports>
Nov 07 04:07:09 user nova-compute[74540]:         <nova:port uuid="a666b729-73b7-4953-871d-fa236a4dd3f0">
Nov 07 04:07:09 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 07 04:07:09 user nova-compute[74540]:         </nova:port>
Nov 07 04:07:09 user nova-compute[74540]:       </nova:ports>
Nov 07 04:07:09 user nova-compute[74540]:     </nova:instance>
Nov 07 04:07:09 user nova-compute[74540]:   </metadata>
Nov 07 04:07:09 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:07:09 user nova-compute[74540]:     <system>
Nov 07 04:07:09 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:07:09 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:07:09 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:07:09 user nova-compute[74540]:       <entry name="serial">bb6c2f59-c949-4df8-a6e4-ed92d7926639</entry>
Nov 07 04:07:09 user nova-compute[74540]:       <entry name="uuid">bb6c2f59-c949-4df8-a6e4-ed92d7926639</entry>
Nov 07 04:07:09 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:07:09 user nova-compute[74540]:     </system>
Nov 07 04:07:09 user nova-compute[74540]:   </sysinfo>
Nov 07 04:07:09 user nova-compute[74540]:   <os>
Nov 07 04:07:09 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:07:09 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:07:09 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:07:09 user nova-compute[74540]:   </os>
Nov 07 04:07:09 user nova-compute[74540]:   <features>
Nov 07 04:07:09 user nova-compute[74540]:     <acpi/>
Nov 07 04:07:09 user nova-compute[74540]:     <apic/>
Nov 07 04:07:09 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:07:09 user nova-compute[74540]:   </features>
Nov 07 04:07:09 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:07:09 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:07:09 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:07:09 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:07:09 user nova-compute[74540]:   </clock>
Nov 07 04:07:09 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:07:09 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:07:09 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:07:09 user nova-compute[74540]:   </cpu>
Nov 07 04:07:09 user nova-compute[74540]:   <devices>
Nov 07 04:07:09 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:07:09 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:07:09 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk"/>
Nov 07 04:07:09 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:07:09 user nova-compute[74540]:     </disk>
Nov 07 04:07:09 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:07:09 user nova-compute[74540]:       <mac address="fa:16:3e:94:0f:94"/>
Nov 07 04:07:09 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:07:09 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:07:09 user nova-compute[74540]:       <target dev="tapa666b729-73"/>
Nov 07 04:07:09 user nova-compute[74540]:     </interface>
Nov 07 04:07:09 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:07:09 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/console.log" append="off"/>
Nov 07 04:07:09 user nova-compute[74540]:     </serial>
Nov 07 04:07:09 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:07:09 user nova-compute[74540]:     <video>
Nov 07 04:07:09 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:07:09 user nova-compute[74540]:     </video>
Nov 07 04:07:09 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:07:09 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:07:09 user nova-compute[74540]:     </rng>
Nov 07 04:07:09 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:07:09 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:07:09 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:07:09 user nova-compute[74540]:     </memballoon>
Nov 07 04:07:09 user nova-compute[74540]:   </devices>
Nov 07 04:07:09 user nova-compute[74540]: </domain>
Nov 07 04:07:09 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-767517572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-767517572',id=23,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-a9gdx7mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:07:07Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=bb6c2f59-c949-4df8-a6e4-ed92d7926639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=a666b729-73b7-4953-871d-fa236a4dd3f0,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa666b729-73') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG os_vif [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=a666b729-73b7-4953-871d-fa236a4dd3f0,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa666b729-73') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c3176eb-e0bb-5e33-8071-29186d3971b0', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa666b729-73, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa666b729-73, col_values=(('qos', UUID('70cde111-1a1b-4fda-a9f9-b6c50d042bcb')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa666b729-73, col_values=(('external_ids', {'iface-id': 'a666b729-73b7-4953-871d-fa236a4dd3f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:0f:94', 'vm-uuid': 'bb6c2f59-c949-4df8-a6e4-ed92d7926639'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:09 user nova-compute[74540]: INFO os_vif [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=a666b729-73b7-4953-871d-fa236a4dd3f0,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa666b729-73')
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:07:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No VIF found with MAC fa:16:3e:94:0f:94, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG nova.compute.manager [req-c4347a1b-8794-41f2-b2f4-a0f3283bd69f req-6bc9c571-6013-463b-92a4-a5b0bf7f2e69 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Received event network-changed-a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG nova.compute.manager [req-c4347a1b-8794-41f2-b2f4-a0f3283bd69f req-6bc9c571-6013-463b-92a4-a5b0bf7f2e69 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Refreshing instance network info cache due to event network-changed-a666b729-73b7-4953-871d-fa236a4dd3f0. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c4347a1b-8794-41f2-b2f4-a0f3283bd69f req-6bc9c571-6013-463b-92a4-a5b0bf7f2e69 service nova] Acquiring lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c4347a1b-8794-41f2-b2f4-a0f3283bd69f req-6bc9c571-6013-463b-92a4-a5b0bf7f2e69 service nova] Acquired lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG nova.network.neutron [req-c4347a1b-8794-41f2-b2f4-a0f3283bd69f req-6bc9c571-6013-463b-92a4-a5b0bf7f2e69 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Refreshing network info cache for port a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG nova.network.neutron [req-c4347a1b-8794-41f2-b2f4-a0f3283bd69f req-6bc9c571-6013-463b-92a4-a5b0bf7f2e69 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updated VIF entry in instance network info cache for port a666b729-73b7-4953-871d-fa236a4dd3f0. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG nova.network.neutron [req-c4347a1b-8794-41f2-b2f4-a0f3283bd69f req-6bc9c571-6013-463b-92a4-a5b0bf7f2e69 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updating instance_info_cache with network_info: [{"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c4347a1b-8794-41f2-b2f4-a0f3283bd69f req-6bc9c571-6013-463b-92a4-a5b0bf7f2e69 service nova] Releasing lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-e73c1a93-9dd9-4a7d-adc3-0afb8012b605 req-48c20cce-0117-4fc6-b2eb-9a701f75ed8a service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Received event network-vif-plugged-a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e73c1a93-9dd9-4a7d-adc3-0afb8012b605 req-48c20cce-0117-4fc6-b2eb-9a701f75ed8a service nova] Acquiring lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e73c1a93-9dd9-4a7d-adc3-0afb8012b605 req-48c20cce-0117-4fc6-b2eb-9a701f75ed8a service nova] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e73c1a93-9dd9-4a7d-adc3-0afb8012b605 req-48c20cce-0117-4fc6-b2eb-9a701f75ed8a service nova] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-e73c1a93-9dd9-4a7d-adc3-0afb8012b605 req-48c20cce-0117-4fc6-b2eb-9a701f75ed8a service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] No waiting events found dispatching network-vif-plugged-a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:12 user nova-compute[74540]: WARNING nova.compute.manager [req-e73c1a93-9dd9-4a7d-adc3-0afb8012b605 req-48c20cce-0117-4fc6-b2eb-9a701f75ed8a service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Received unexpected event network-vif-plugged-a666b729-73b7-4953-871d-fa236a4dd3f0 for instance with vm_state building and task_state spawning.
Nov 07 04:07:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-e73c1a93-9dd9-4a7d-adc3-0afb8012b605 req-48c20cce-0117-4fc6-b2eb-9a701f75ed8a service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Received event network-vif-plugged-a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e73c1a93-9dd9-4a7d-adc3-0afb8012b605 req-48c20cce-0117-4fc6-b2eb-9a701f75ed8a service nova] Acquiring lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e73c1a93-9dd9-4a7d-adc3-0afb8012b605 req-48c20cce-0117-4fc6-b2eb-9a701f75ed8a service nova] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e73c1a93-9dd9-4a7d-adc3-0afb8012b605 req-48c20cce-0117-4fc6-b2eb-9a701f75ed8a service nova] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-e73c1a93-9dd9-4a7d-adc3-0afb8012b605 req-48c20cce-0117-4fc6-b2eb-9a701f75ed8a service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] No waiting events found dispatching network-vif-plugged-a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:12 user nova-compute[74540]: WARNING nova.compute.manager [req-e73c1a93-9dd9-4a7d-adc3-0afb8012b605 req-48c20cce-0117-4fc6-b2eb-9a701f75ed8a service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Received unexpected event network-vif-plugged-a666b729-73b7-4953-871d-fa236a4dd3f0 for instance with vm_state building and task_state spawning.
Nov 07 04:07:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:07:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:07:13 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Instance spawned successfully.
Nov 07 04:07:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:07:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:07:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:07:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:07:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:07:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:07:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:07:13 user nova-compute[74540]: INFO nova.compute.manager [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 07 04:07:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:07:13 user nova-compute[74540]: INFO nova.compute.manager [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Took 6.80 seconds to build instance.
Nov 07 04:07:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ef5754a4-3e8a-4f06-9e9f-1a2a8baed5f7 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.899s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG nova.objects.instance [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'pci_requests' on Instance uuid 6b84cdaa-6964-4e16-95b3-accb9086d871 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG nova.objects.instance [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'numa_topology' on Instance uuid 6b84cdaa-6964-4e16-95b3-accb9086d871 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:07:28 user nova-compute[74540]: INFO nova.compute.claims [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Claim successful on node user
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "45cf1e18-0792-451b-8022-000ba35ad605" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:28 user nova-compute[74540]: INFO nova.compute.manager [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Terminating instance
Nov 07 04:07:28 user nova-compute[74540]: DEBUG nova.compute.manager [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-57f1e219-8847-40ff-bd02-7a3db08fefbf req-83dad9cc-fc0b-4cf5-8f61-141db7ca8ae3 service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-vif-unplugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-57f1e219-8847-40ff-bd02-7a3db08fefbf req-83dad9cc-fc0b-4cf5-8f61-141db7ca8ae3 service nova] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-57f1e219-8847-40ff-bd02-7a3db08fefbf req-83dad9cc-fc0b-4cf5-8f61-141db7ca8ae3 service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-57f1e219-8847-40ff-bd02-7a3db08fefbf req-83dad9cc-fc0b-4cf5-8f61-141db7ca8ae3 service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-57f1e219-8847-40ff-bd02-7a3db08fefbf req-83dad9cc-fc0b-4cf5-8f61-141db7ca8ae3 service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] No waiting events found dispatching network-vif-unplugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-57f1e219-8847-40ff-bd02-7a3db08fefbf req-83dad9cc-fc0b-4cf5-8f61-141db7ca8ae3 service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-vif-unplugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:28 user nova-compute[74540]: INFO nova.network.neutron [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updating port 3432fa44-5aef-4f35-bc32-9c41738d5eba with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74540) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 04:07:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Instance destroyed successfully.
Nov 07 04:07:29 user nova-compute[74540]: DEBUG nova.objects.instance [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'resources' on Instance uuid 45cf1e18-0792-451b-8022-000ba35ad605 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1013489216',display_name='tempest-AttachVolumeNegativeTest-server-1013489216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1013489216',id=19,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/MCElulRiJ/9B/40jlsiWJf8Jcy8+irukKGC/rt0ohtiJVrIBxdnEYukZsUf7EsICgw9/O8o/mk+RI5nPHKVIbDfPP6cJDfxyTMZ38YWZ5RGkulgJrymVrlh/cqn2WaA==',key_name='tempest-keypair-1108126652',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:04:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='620cefdadcec49d6a696aa7db8cef2d1',ramdisk_id='',reservation_id='r-1zrlj03s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-306463361',owner_user_name='tempest-AttachVolumeNegativeTest-306463361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3079ba3a84ea4b4bb4a3e576ab4133ae',uuid=45cf1e18-0792-451b-8022-000ba35ad605,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "address": "fa:16:3e:a5:ae:91", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a999f3e-8c", "ovs_interfaceid": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converting VIF {"id": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "address": "fa:16:3e:a5:ae:91", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a999f3e-8c", "ovs_interfaceid": "4a999f3e-8cfa-4a58-871d-76baa2cec648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:ae:91,bridge_name='br-int',has_traffic_filtering=True,id=4a999f3e-8cfa-4a58-871d-76baa2cec648,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a999f3e-8c') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG os_vif [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:ae:91,bridge_name='br-int',has_traffic_filtering=True,id=4a999f3e-8cfa-4a58-871d-76baa2cec648,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a999f3e-8c') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a999f3e-8c, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04ec5692-8a7c-4ab4-bb56-1d7ca6b53eb1) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: INFO os_vif [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:ae:91,bridge_name='br-int',has_traffic_filtering=True,id=4a999f3e-8cfa-4a58-871d-76baa2cec648,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a999f3e-8c')
Nov 07 04:07:29 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Deleting instance files /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605_del
Nov 07 04:07:29 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Deletion of /opt/stack/data/nova/instances/45cf1e18-0792-451b-8022-000ba35ad605_del complete
Nov 07 04:07:29 user nova-compute[74540]: INFO nova.compute.manager [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 07 04:07:29 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquired lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-926d61e0-5186-4a12-a2de-4d2d32e11237 req-86bf547f-be49-4ba2-92f8-de6d4a673c43 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-changed-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-926d61e0-5186-4a12-a2de-4d2d32e11237 req-86bf547f-be49-4ba2-92f8-de6d4a673c43 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Refreshing instance network info cache due to event network-changed-3432fa44-5aef-4f35-bc32-9c41738d5eba. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-926d61e0-5186-4a12-a2de-4d2d32e11237 req-86bf547f-be49-4ba2-92f8-de6d4a673c43 service nova] Acquiring lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:30 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updating instance_info_cache with network_info: [{"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:07:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Releasing lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:07:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:07:30 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Creating image(s)
Nov 07 04:07:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "/opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "/opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:30 user nova-compute[74540]: DEBUG nova.objects.instance [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6b84cdaa-6964-4e16-95b3-accb9086d871 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-926d61e0-5186-4a12-a2de-4d2d32e11237 req-86bf547f-be49-4ba2-92f8-de6d4a673c43 service nova] Acquired lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:07:30 user nova-compute[74540]: DEBUG nova.network.neutron [req-926d61e0-5186-4a12-a2de-4d2d32e11237 req-86bf547f-be49-4ba2-92f8-de6d4a673c43 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Refreshing network info cache for port 3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:07:30 user nova-compute[74540]: DEBUG nova.objects.base [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Object Instance<6b84cdaa-6964-4e16-95b3-accb9086d871> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:07:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "7e21b159470e91fd835d8a5ab1b2563527a161de" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "7e21b159470e91fd835d8a5ab1b2563527a161de" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de.part --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] No waiting events found dispatching network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:31 user nova-compute[74540]: WARNING nova.compute.manager [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received unexpected event network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 for instance with vm_state active and task_state deleting.
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] No waiting events found dispatching network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:31 user nova-compute[74540]: WARNING nova.compute.manager [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received unexpected event network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 for instance with vm_state active and task_state deleting.
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] No waiting events found dispatching network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:31 user nova-compute[74540]: WARNING nova.compute.manager [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received unexpected event network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 for instance with vm_state active and task_state deleting.
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-vif-unplugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] No waiting events found dispatching network-vif-unplugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-f3dc8290-7b34-4d1c-9e03-47968e09df42 req-0f389a82-f685-4567-8c65-b6ca99b987ae service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-vif-unplugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:07:31 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Took 1.98 seconds to deallocate network for instance.
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.virt.images [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] dff8b747-7313-4963-aa69-6c2e68878c8d was qcow2, converting to raw {{(pid=74540) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de.part /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de.converted {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxYcmgNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:07:31 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:07:31 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:07:31 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c6bbda-3bc6-4b44-8183-80eb229a3fd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:07:31 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4922af1-4041-46b3-9db1-2d45a5433a19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a] added
Nov 07 04:07:31 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[258c5972-1c68-4b9d-b533-27a93c376d17]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dae601-24ec-4769-9748-3f6bf2211d07]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxYcmgNq {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxYcmgNq" returned: 0 in 0.164s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8d9a06-7ac9-481e-bf4a-baf35c0c0ddc]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XxYcmgNq'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.network.neutron [req-926d61e0-5186-4a12-a2de-4d2d32e11237 req-86bf547f-be49-4ba2-92f8-de6d4a673c43 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updated VIF entry in instance network info cache for port 3432fa44-5aef-4f35-bc32-9c41738d5eba. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.network.neutron [req-926d61e0-5186-4a12-a2de-4d2d32e11237 req-86bf547f-be49-4ba2-92f8-de6d4a673c43 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updating instance_info_cache with network_info: [{"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7898b9-756d-4ad7-bed6-b309fd2c15bf]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de.part /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de.converted" returned: 0 in 0.444s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de.converted --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bedc06f-e311-4850-a02b-6cb921aa2a73]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:31 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:31 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-926d61e0-5186-4a12-a2de-4d2d32e11237 req-86bf547f-be49-4ba2-92f8-de6d4a673c43 service nova] Releasing lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97cf6c9-cc0d-46dd-8885-864a6cee8aea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a, portal: 172.16.0.220,3260]
Nov 07 04:07:31 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a, portal: 172.16.0.220,3260] successful.
Nov 07 04:07:31 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71037eb-ba25-4402-8be1-4c6f58193f1c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdeb3c1-514b-4ccc-91ba-511fd8c0b175]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:31 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:31 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:31 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:31 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.562s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a6de71-3abf-4173-a3d8-e97450d59255]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "7e21b159470e91fd835d8a5ab1b2563527a161de" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.931s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.722s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:32 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Deleted allocations for instance 45cf1e18-0792-451b-8022-000ba35ad605
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de --force-share --output=json" returned: 0 in 0.202s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "7e21b159470e91fd835d8a5ab1b2563527a161de" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "7e21b159470e91fd835d8a5ab1b2563527a161de" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fffa9deb-8069-4b83-8cf4-dd9e7ea3a6bd tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "45cf1e18-0792-451b-8022-000ba35ad605" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.076s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de,backing_fmt=raw /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de,backing_fmt=raw /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk 1073741824" returned: 0 in 0.055s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "7e21b159470e91fd835d8a5ab1b2563527a161de" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de --force-share --output=json" returned: 0 in 0.170s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG nova.objects.instance [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'migration_context' on Instance uuid 6b84cdaa-6964-4e16-95b3-accb9086d871 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG nova.objects.base [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Object Instance<6b84cdaa-6964-4e16-95b3-accb9086d871> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:07:32 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Rebasing disk image.
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG nova.compute.manager [req-f3e65cec-bc89-4747-b5f9-44077d328cc9 req-a67e8e6a-736f-4cb6-bf94-ce45eb21cf44 service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3e65cec-bc89-4747-b5f9-44077d328cc9 req-a67e8e6a-736f-4cb6-bf94-ce45eb21cf44 service nova] Acquiring lock "45cf1e18-0792-451b-8022-000ba35ad605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3e65cec-bc89-4747-b5f9-44077d328cc9 req-a67e8e6a-736f-4cb6-bf94-ce45eb21cf44 service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f3e65cec-bc89-4747-b5f9-44077d328cc9 req-a67e8e6a-736f-4cb6-bf94-ce45eb21cf44 service nova] Lock "45cf1e18-0792-451b-8022-000ba35ad605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG nova.compute.manager [req-f3e65cec-bc89-4747-b5f9-44077d328cc9 req-a67e8e6a-736f-4cb6-bf94-ce45eb21cf44 service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] No waiting events found dispatching network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:32 user nova-compute[74540]: WARNING nova.compute.manager [req-f3e65cec-bc89-4747-b5f9-44077d328cc9 req-a67e8e6a-736f-4cb6-bf94-ce45eb21cf44 service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received unexpected event network-vif-plugged-4a999f3e-8cfa-4a58-871d-76baa2cec648 for instance with vm_state deleted and task_state None.
Nov 07 04:07:32 user nova-compute[74540]: DEBUG nova.compute.manager [req-f3e65cec-bc89-4747-b5f9-44077d328cc9 req-a67e8e6a-736f-4cb6-bf94-ce45eb21cf44 service nova] [instance: 45cf1e18-0792-451b-8022-000ba35ad605] Received event network-vif-deleted-4a999f3e-8cfa-4a58-871d-76baa2cec648 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c -F raw /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] There are 0 instances to clean {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxYcmgNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.598s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] <== connect_volume: return (1600ms) {'type': 'block', 'scsi_wwn': '23566323762613932', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566323762613932', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:07:32 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'flavor' on Instance uuid d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:07:33 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:07:33 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:07:33 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:07:33 user nova-compute[74540]:   <serial>485b0b7f-affb-4576-beb6-807efcbe5c0a</serial>
Nov 07 04:07:33 user nova-compute[74540]: </disk>
Nov 07 04:07:33 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No VIF found with MAC fa:16:3e:25:3f:df, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thiHvNkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:07:33 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:07:33 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:07:33 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b098149-56dc-4512-8ddf-ff6524aae91c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:07:33 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[825ef057-84da-4453-82af-923d817e6ec5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814] added
Nov 07 04:07:33 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ca70a450-c0fb-44b3-8d23-e0d0710c4cd3 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.302s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44410ea-3166-43e6-b832-2bb6d6c76e3c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ddb199-981a-4162-a98c-a03ab17405ce]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v thiHvNkD {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v thiHvNkD" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[af08057e-5c5d-44fc-8e79-77586e4032c1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'thiHvNkD'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f950669b-1fca-4e5b-a181-aa5b21018685]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bd230d-2e29-461a-8e7d-3cdd254f184c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:33 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:33 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:33 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:33 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca06c8a-310f-4fa1-b773-3672aa567c75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260]
Nov 07 04:07:33 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260] successful.
Nov 07 04:07:33 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fca0ad-a246-4f3a-abd5-dcb9d494fc7a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a9c4c-f35f-4185-9d9a-a63b1c43624d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:33 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:33 user nova-compute[74540]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:07:33 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:33 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:33 user nova-compute[74540]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:07:33 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.033s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a79b86b-9bb8-473b-a6ef-f071f3b2c2e7]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:07:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thiHvNkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:07:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:34 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23036306530393234', 'path': '/dev/sdd'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036306530393234', 'path': '/dev/sdd'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.objects.instance [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lazy-loading 'flavor' on Instance uuid 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:07:35 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:07:35 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:07:35 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:07:35 user nova-compute[74540]:   <serial>b195147d-b815-42ae-86a8-6a05a4936814</serial>
Nov 07 04:07:35 user nova-compute[74540]: </disk>
Nov 07 04:07:35 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:07:35 user nova-compute[74540]: INFO nova.compute.manager [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Rescuing
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquired lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.network.neutron [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c -F raw /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk" returned: 0 in 2.794s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Ensure instance console log exists: /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Start _get_guest_xml network_info=[{"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='fe02d326fc6dfcd58415707b11bdf883',container_format='bare',created_at=2023-11-07T04:04:48Z,direct_url=<?>,disk_format='qcow2',id=dff8b747-7313-4963-aa69-6c2e68878c8d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1095963237-shelved',owner='796865203135404b8624363d533ae6fe',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-07T04:04:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBcSiPxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '6b84cdaa-6964-4e16-95b3-accb9086d871', 'attached_at': '', 'detached_at': '', 'volume_id': '5b341039-9c2b-41c2-8276-0b304d2bbb5c', 'serial': '5b341039-9c2b-41c2-8276-0b304d2bbb5c'}, 'boot_index': None, 'attachment_id': '00734cb6-bc46-44d2-98f8-0fde7a6dd536', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:07:35 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:07:35 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fe02d326fc6dfcd58415707b11bdf883',container_format='bare',created_at=2023-11-07T04:04:48Z,direct_url=<?>,disk_format='qcow2',id=dff8b747-7313-4963-aa69-6c2e68878c8d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1095963237-shelved',owner='796865203135404b8624363d533ae6fe',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-07T04:04:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.objects.instance [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6b84cdaa-6964-4e16-95b3-accb9086d871 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.compute.manager [req-8a1d7c81-0fb4-4ed4-8e78-749ce183f281 req-63fac426-0c36-401b-8c51-4ead6a5dd098 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-changed-abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.compute.manager [req-8a1d7c81-0fb4-4ed4-8e78-749ce183f281 req-63fac426-0c36-401b-8c51-4ead6a5dd098 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Refreshing instance network info cache due to event network-changed-abb88c7a-347e-428e-8069-d2419ed701c3. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8a1d7c81-0fb4-4ed4-8e78-749ce183f281 req-63fac426-0c36-401b-8c51-4ead6a5dd098 service nova] Acquiring lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8a1d7c81-0fb4-4ed4-8e78-749ce183f281 req-63fac426-0c36-401b-8c51-4ead6a5dd098 service nova] Acquired lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.network.neutron [req-8a1d7c81-0fb4-4ed4-8e78-749ce183f281 req-63fac426-0c36-401b-8c51-4ead6a5dd098 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Refreshing network info cache for port abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.objects.base [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Object Instance<6b84cdaa-6964-4e16-95b3-accb9086d871> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBcSiPxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:07:35 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:07:35 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:07:35 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[528a55d1-f516-489a-92d3-1c312ddfced7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:07:35 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9aa429-a263-4d10-bed2-05cd1f7e395b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c] added
Nov 07 04:07:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95b42bb-6bfa-4455-b205-db02b6c45270]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1476a0ba-e2e1-4b46-8c62-41a2f6e4f54f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBcSiPxv {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No VIF found with MAC fa:16:3e:21:1b:68, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBcSiPxv" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d08293b-b27d-43fd-bbf0-266aa68ecd4a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZBcSiPxv'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ad67a9-2558-4278-8f9b-aa10a0f88f7c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e545c899-4c0d-487f-8407-54a0f58a87ff]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:35 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:35 user nova-compute[74540]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:07:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:35 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:35 user nova-compute[74540]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:07:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:07:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[caae136d-caa6-410a-aa0b-6bc9040deb52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c, portal: 172.16.0.220,3260]
Nov 07 04:07:36 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c, portal: 172.16.0.220,3260] successful.
Nov 07 04:07:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-51fec5b9-d798-45ad-ae05-45666b3c3c97 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.941s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d8b9b9-d89d-4ba6-b13a-5e3f937faeff]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG nova.network.neutron [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updating instance_info_cache with network_info: [{"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Releasing lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56e1e4c-2f59-4463-847e-4b9e9bccdeaf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:36 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:36 user nova-compute[74540]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:07:36 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:07:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:36 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:36 user nova-compute[74540]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:07:36 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:07:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[967b887b-aea5-43cb-a275-fbeae3e20cc7]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBcSiPxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "interface-332796aa-adda-40ef-8650-126641e30821-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "interface-332796aa-adda-40ef-8650-126641e30821-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG nova.objects.instance [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lazy-loading 'flavor' on Instance uuid 332796aa-adda-40ef-8650-126641e30821 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG nova.network.neutron [req-8a1d7c81-0fb4-4ed4-8e78-749ce183f281 req-63fac426-0c36-401b-8c51-4ead6a5dd098 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Updated VIF entry in instance network info cache for port abb88c7a-347e-428e-8069-d2419ed701c3. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG nova.network.neutron [req-8a1d7c81-0fb4-4ed4-8e78-749ce183f281 req-63fac426-0c36-401b-8c51-4ead6a5dd098 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Updating instance_info_cache with network_info: [{"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8a1d7c81-0fb4-4ed4-8e78-749ce183f281 req-63fac426-0c36-401b-8c51-4ead6a5dd098 service nova] Releasing lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG nova.objects.instance [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lazy-loading 'pci_requests' on Instance uuid 332796aa-adda-40ef-8650-126641e30821 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG nova.objects.base [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Object Instance<332796aa-adda-40ef-8650-126641e30821> lazy-loaded attributes: flavor,pci_requests {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG nova.network.neutron [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG nova.policy [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f469ca83fe184f1698ed812016fb5b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac7b6c7a58f842129f0f27294085214a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:37 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Instance destroyed successfully.
Nov 07 04:07:37 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Attempting rescue
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74540) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Instance directory exists: not creating {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 04:07:37 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Creating image(s)
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "/opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "/opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "/opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.instance [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'trusted_certs' on Instance uuid d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.network.neutron [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Successfully created port: 69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23932383061363665', 'path': '/dev/sde'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932383061363665', 'path': '/dev/sde'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T04:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1095963237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1095963237',id=16,image_ref='dff8b747-7313-4963-aa69-6c2e68878c8d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-660584599',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:02:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='796865203135404b8624363d533ae6fe',ramdisk_id='',reservation_id='r-cso2bngu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952443794',owner_user_name='tempest-AttachVolumeShelveTestJSON-952443794-project-member',shelved_at='2023-11-07T04:04:52.153545',shelved_host='user',shelved_image_id='dff8b747-7313-4963-aa69-6c2e68878c8d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fad238078941dba4cc57406b1c69ed',uuid=6b84cdaa-6964-4e16-95b3-accb9086d871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converting VIF {"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.instance [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b84cdaa-6964-4e16-95b3-accb9086d871 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.base [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Object Instance<6b84cdaa-6964-4e16-95b3-accb9086d871> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:07:37 user nova-compute[74540]:   <uuid>6b84cdaa-6964-4e16-95b3-accb9086d871</uuid>
Nov 07 04:07:37 user nova-compute[74540]:   <name>instance-00000010</name>
Nov 07 04:07:37 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:07:37 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:07:37 user nova-compute[74540]:   <metadata>
Nov 07 04:07:37 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:07:37 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:07:37 user nova-compute[74540]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1095963237</nova:name>
Nov 07 04:07:37 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:07:35</nova:creationTime>
Nov 07 04:07:37 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:07:37 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:07:37 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:07:37 user nova-compute[74540]:       <nova:owner>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:user uuid="47fad238078941dba4cc57406b1c69ed">tempest-AttachVolumeShelveTestJSON-952443794-project-member</nova:user>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:project uuid="796865203135404b8624363d533ae6fe">tempest-AttachVolumeShelveTestJSON-952443794</nova:project>
Nov 07 04:07:37 user nova-compute[74540]:       </nova:owner>
Nov 07 04:07:37 user nova-compute[74540]:       <nova:root type="image" uuid="dff8b747-7313-4963-aa69-6c2e68878c8d"/>
Nov 07 04:07:37 user nova-compute[74540]:       <nova:ports>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:port uuid="3432fa44-5aef-4f35-bc32-9c41738d5eba">
Nov 07 04:07:37 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 04:07:37 user nova-compute[74540]:         </nova:port>
Nov 07 04:07:37 user nova-compute[74540]:       </nova:ports>
Nov 07 04:07:37 user nova-compute[74540]:     </nova:instance>
Nov 07 04:07:37 user nova-compute[74540]:   </metadata>
Nov 07 04:07:37 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:07:37 user nova-compute[74540]:     <system>
Nov 07 04:07:37 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:07:37 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:07:37 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:07:37 user nova-compute[74540]:       <entry name="serial">6b84cdaa-6964-4e16-95b3-accb9086d871</entry>
Nov 07 04:07:37 user nova-compute[74540]:       <entry name="uuid">6b84cdaa-6964-4e16-95b3-accb9086d871</entry>
Nov 07 04:07:37 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:07:37 user nova-compute[74540]:     </system>
Nov 07 04:07:37 user nova-compute[74540]:   </sysinfo>
Nov 07 04:07:37 user nova-compute[74540]:   <os>
Nov 07 04:07:37 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:07:37 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:07:37 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:07:37 user nova-compute[74540]:   </os>
Nov 07 04:07:37 user nova-compute[74540]:   <features>
Nov 07 04:07:37 user nova-compute[74540]:     <acpi/>
Nov 07 04:07:37 user nova-compute[74540]:     <apic/>
Nov 07 04:07:37 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:07:37 user nova-compute[74540]:   </features>
Nov 07 04:07:37 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:07:37 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:07:37 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:07:37 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:07:37 user nova-compute[74540]:   </clock>
Nov 07 04:07:37 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:07:37 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:07:37 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:07:37 user nova-compute[74540]:   </cpu>
Nov 07 04:07:37 user nova-compute[74540]:   <devices>
Nov 07 04:07:37 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:07:37 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:07:37 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk"/>
Nov 07 04:07:37 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:07:37 user nova-compute[74540]:     </disk>
Nov 07 04:07:37 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:07:37 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:07:37 user nova-compute[74540]:       <source dev="/dev/sde"/>
Nov 07 04:07:37 user nova-compute[74540]:       <target dev="vdc" bus="virtio"/>
Nov 07 04:07:37 user nova-compute[74540]:       <serial>5b341039-9c2b-41c2-8276-0b304d2bbb5c</serial>
Nov 07 04:07:37 user nova-compute[74540]:     </disk>
Nov 07 04:07:37 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:07:37 user nova-compute[74540]:       <mac address="fa:16:3e:bb:84:42"/>
Nov 07 04:07:37 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:07:37 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:07:37 user nova-compute[74540]:       <target dev="tap3432fa44-5a"/>
Nov 07 04:07:37 user nova-compute[74540]:     </interface>
Nov 07 04:07:37 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:07:37 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/console.log" append="off"/>
Nov 07 04:07:37 user nova-compute[74540]:     </serial>
Nov 07 04:07:37 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:07:37 user nova-compute[74540]:     <video>
Nov 07 04:07:37 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:07:37 user nova-compute[74540]:     </video>
Nov 07 04:07:37 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:07:37 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:07:37 user nova-compute[74540]:     </rng>
Nov 07 04:07:37 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:07:37 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:07:37 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:07:37 user nova-compute[74540]:     </memballoon>
Nov 07 04:07:37 user nova-compute[74540]:   </devices>
Nov 07 04:07:37 user nova-compute[74540]: </domain>
Nov 07 04:07:37 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T04:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1095963237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1095963237',id=16,image_ref='dff8b747-7313-4963-aa69-6c2e68878c8d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-660584599',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:02:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='796865203135404b8624363d533ae6fe',ramdisk_id='',reservation_id='r-cso2bngu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952443794',owner_user_name='tempest-AttachVolumeShelveTestJSON-952443794-project-member',shelved_at='2023-11-07T04:04:52.153545',shelved_host='user',shelved_image_id='dff8b747-7313-4963-aa69-6c2e68878c8d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fad238078941dba4cc57406b1c69ed',uuid=6b84cdaa-6964-4e16-95b3-accb9086d871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converting VIF {"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG os_vif [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd323124-cc15-5ba8-9574-41fb536355af', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3432fa44-5a, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3432fa44-5a, col_values=(('qos', UUID('de53a538-bb1b-40d1-8f84-29daa9f51b6f')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3432fa44-5a, col_values=(('external_ids', {'iface-id': '3432fa44-5aef-4f35-bc32-9c41738d5eba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:84:42', 'vm-uuid': '6b84cdaa-6964-4e16-95b3-accb9086d871'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:37 user nova-compute[74540]: INFO os_vif [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a')
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.251s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.rescue {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] No VIF found with MAC fa:16:3e:bb:84:42, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.rescue" returned: 0 in 0.063s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.instance [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'migration_context' on Instance uuid d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.base [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<d61ec49c-3345-4808-bfcd-a9d925fe1918> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Start _get_guest_xml network_info=[{"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "vif_mac": "fa:16:3e:25:3f:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.instance [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'resources' on Instance uuid d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:37 user nova-compute[74540]: INFO nova.compute.manager [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Rebuilding instance
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.base [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<d61ec49c-3345-4808-bfcd-a9d925fe1918> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.instance [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'numa_topology' on Instance uuid d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.base [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<d61ec49c-3345-4808-bfcd-a9d925fe1918> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:07:37 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:07:37 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.instance [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'vcpu_model' on Instance uuid d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.base [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<d61ec49c-3345-4808-bfcd-a9d925fe1918> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1133225386',display_name='tempest-ServerRescueNegativeTestJSON-server-1133225386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1133225386',id=20,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBj9JGEc9VyV8YeUoPMa9NDSJ54Ho4a2bbet4FxPNE2x3GRflCHypDOaqiWCZvHqb4axwgd1tVOhLjsH76krDJ7R06NDk6czZdeoCJ8xnQsEpDVmGkxfD1VqTkuh/PGlLA==',key_name='tempest-keypair-374854339',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60a9f3df6bba4675b2332ac4ded5373e',ramdisk_id='',reservation_id='r-jg0mo70g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1326022799',owner_user_name='tempest-ServerRescueNegativeTestJSON-1326022799-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b660fa816a404196af3027d19aea51',uuid=d61ec49c-3345-4808-bfcd-a9d925fe1918,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "vif_mac": "fa:16:3e:25:3f:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converting VIF {"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "vif_mac": "fa:16:3e:25:3f:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:3f:df,bridge_name='br-int',has_traffic_filtering=True,id=82decd3b-b1ba-4b4c-88ab-fbae31e34394,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82decd3b-b1') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.instance [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'pci_devices' on Instance uuid d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.objects.base [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Object Instance<d61ec49c-3345-4808-bfcd-a9d925fe1918> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:07:37 user nova-compute[74540]:   <uuid>d61ec49c-3345-4808-bfcd-a9d925fe1918</uuid>
Nov 07 04:07:37 user nova-compute[74540]:   <name>instance-00000014</name>
Nov 07 04:07:37 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:07:37 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:07:37 user nova-compute[74540]:   <metadata>
Nov 07 04:07:37 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:07:37 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:07:37 user nova-compute[74540]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1133225386</nova:name>
Nov 07 04:07:37 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:07:37</nova:creationTime>
Nov 07 04:07:37 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:07:37 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:07:37 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:07:37 user nova-compute[74540]:       <nova:owner>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:user uuid="c3b660fa816a404196af3027d19aea51">tempest-ServerRescueNegativeTestJSON-1326022799-project-member</nova:user>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:project uuid="60a9f3df6bba4675b2332ac4ded5373e">tempest-ServerRescueNegativeTestJSON-1326022799</nova:project>
Nov 07 04:07:37 user nova-compute[74540]:       </nova:owner>
Nov 07 04:07:37 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:07:37 user nova-compute[74540]:       <nova:ports>
Nov 07 04:07:37 user nova-compute[74540]:         <nova:port uuid="82decd3b-b1ba-4b4c-88ab-fbae31e34394">
Nov 07 04:07:37 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:07:37 user nova-compute[74540]:         </nova:port>
Nov 07 04:07:37 user nova-compute[74540]:       </nova:ports>
Nov 07 04:07:37 user nova-compute[74540]:     </nova:instance>
Nov 07 04:07:37 user nova-compute[74540]:   </metadata>
Nov 07 04:07:37 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:07:37 user nova-compute[74540]:     <system>
Nov 07 04:07:37 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:07:37 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:07:37 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:07:37 user nova-compute[74540]:       <entry name="serial">d61ec49c-3345-4808-bfcd-a9d925fe1918</entry>
Nov 07 04:07:37 user nova-compute[74540]:       <entry name="uuid">d61ec49c-3345-4808-bfcd-a9d925fe1918</entry>
Nov 07 04:07:37 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:07:37 user nova-compute[74540]:     </system>
Nov 07 04:07:37 user nova-compute[74540]:   </sysinfo>
Nov 07 04:07:37 user nova-compute[74540]:   <os>
Nov 07 04:07:37 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:07:37 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:07:37 user nova-compute[74540]:   </os>
Nov 07 04:07:37 user nova-compute[74540]:   <features>
Nov 07 04:07:37 user nova-compute[74540]:     <acpi/>
Nov 07 04:07:37 user nova-compute[74540]:     <apic/>
Nov 07 04:07:37 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:07:37 user nova-compute[74540]:   </features>
Nov 07 04:07:37 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:07:37 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:07:37 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:07:37 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:07:37 user nova-compute[74540]:   </clock>
Nov 07 04:07:37 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:07:37 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:07:37 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:07:37 user nova-compute[74540]:   </cpu>
Nov 07 04:07:37 user nova-compute[74540]:   <devices>
Nov 07 04:07:37 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:07:37 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:07:37 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.rescue"/>
Nov 07 04:07:37 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:07:37 user nova-compute[74540]:     </disk>
Nov 07 04:07:37 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:07:37 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:07:37 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk"/>
Nov 07 04:07:37 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 04:07:37 user nova-compute[74540]:     </disk>
Nov 07 04:07:37 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:07:37 user nova-compute[74540]:       <mac address="fa:16:3e:25:3f:df"/>
Nov 07 04:07:37 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:07:37 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:07:37 user nova-compute[74540]:       <target dev="tap82decd3b-b1"/>
Nov 07 04:07:37 user nova-compute[74540]:     </interface>
Nov 07 04:07:37 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:07:37 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/console.log" append="off"/>
Nov 07 04:07:37 user nova-compute[74540]:     </serial>
Nov 07 04:07:37 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:07:37 user nova-compute[74540]:     <video>
Nov 07 04:07:37 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:07:37 user nova-compute[74540]:     </video>
Nov 07 04:07:37 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:07:37 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:07:37 user nova-compute[74540]:     </rng>
Nov 07 04:07:37 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:07:37 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:07:37 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:07:37 user nova-compute[74540]:     </memballoon>
Nov 07 04:07:37 user nova-compute[74540]:   </devices>
Nov 07 04:07:37 user nova-compute[74540]: </domain>
Nov 07 04:07:37 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:07:37 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Instance destroyed successfully.
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] No VIF found with MAC fa:16:3e:25:3f:df, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.network.neutron [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Successfully updated port: 69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-e58564aa-4624-4376-81f0-56f4170c49eb req-44cc2411-adfc-4392-9ff0-7e8d20cae663 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-vif-unplugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e58564aa-4624-4376-81f0-56f4170c49eb req-44cc2411-adfc-4392-9ff0-7e8d20cae663 service nova] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e58564aa-4624-4376-81f0-56f4170c49eb req-44cc2411-adfc-4392-9ff0-7e8d20cae663 service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e58564aa-4624-4376-81f0-56f4170c49eb req-44cc2411-adfc-4392-9ff0-7e8d20cae663 service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-e58564aa-4624-4376-81f0-56f4170c49eb req-44cc2411-adfc-4392-9ff0-7e8d20cae663 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] No waiting events found dispatching network-vif-unplugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:37 user nova-compute[74540]: WARNING nova.compute.manager [req-e58564aa-4624-4376-81f0-56f4170c49eb req-44cc2411-adfc-4392-9ff0-7e8d20cae663 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received unexpected event network-vif-unplugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 for instance with vm_state active and task_state rescuing.
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-e58564aa-4624-4376-81f0-56f4170c49eb req-44cc2411-adfc-4392-9ff0-7e8d20cae663 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e58564aa-4624-4376-81f0-56f4170c49eb req-44cc2411-adfc-4392-9ff0-7e8d20cae663 service nova] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e58564aa-4624-4376-81f0-56f4170c49eb req-44cc2411-adfc-4392-9ff0-7e8d20cae663 service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e58564aa-4624-4376-81f0-56f4170c49eb req-44cc2411-adfc-4392-9ff0-7e8d20cae663 service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-e58564aa-4624-4376-81f0-56f4170c49eb req-44cc2411-adfc-4392-9ff0-7e8d20cae663 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] No waiting events found dispatching network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:37 user nova-compute[74540]: WARNING nova.compute.manager [req-e58564aa-4624-4376-81f0-56f4170c49eb req-44cc2411-adfc-4392-9ff0-7e8d20cae663 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received unexpected event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 for instance with vm_state active and task_state rescuing.
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquired lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.network.neutron [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-ef13ad2a-1374-4a05-9470-220fa5812ea0 req-8f10813f-289c-4f66-a6ab-fd3b525a11e7 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-changed-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-ef13ad2a-1374-4a05-9470-220fa5812ea0 req-8f10813f-289c-4f66-a6ab-fd3b525a11e7 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Refreshing instance network info cache due to event network-changed-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ef13ad2a-1374-4a05-9470-220fa5812ea0 req-8f10813f-289c-4f66-a6ab-fd3b525a11e7 service nova] Acquiring lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG nova.network.neutron [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Updating instance_info_cache with network_info: [{"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Releasing lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ef13ad2a-1374-4a05-9470-220fa5812ea0 req-8f10813f-289c-4f66-a6ab-fd3b525a11e7 service nova] Acquired lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG nova.network.neutron [req-ef13ad2a-1374-4a05-9470-220fa5812ea0 req-8f10813f-289c-4f66-a6ab-fd3b525a11e7 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Refreshing network info cache for port 69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T04:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583633477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583633477',id=22,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7qsXSGLs+mC92IhCOo9fu/hTPQ5t1+AS7uJm7dv0HXMtIsNXU9ojGEHLtMbGRbnw9Yr5blprgPfBKlEZhTtmiDGlxqbo6WyQ4dq718r+8MLhSRzzyL2Hp9P9gMScDwtA==',key_name='tempest-keypair-1229377363',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac7b6c7a58f842129f0f27294085214a',ramdisk_id='',reservation_id='r-l9bskaef',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-793581715',owner_user_name='tempest-TaggedAttachmentsTest-793581715-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f469ca83fe184f1698ed812016fb5b64',uuid=332796aa-adda-40ef-8650-126641e30821,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converting VIF {"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=69c97beb-2ba9-428a-abcd-8a17f4bf3c1b,network=Network(a79bd329-e3be-44f3-975e-869368c6b5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c97beb-2b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG os_vif [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=69c97beb-2ba9-428a-abcd-8a17f4bf3c1b,network=Network(a79bd329-e3be-44f3-975e-869368c6b5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c97beb-2b') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3215ed92-1836-5604-b45b-ba5936b35892', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69c97beb-2b, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69c97beb-2b, col_values=(('qos', UUID('f025fcdd-7d85-4790-bd74-5ddb0d96ac01')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69c97beb-2b, col_values=(('external_ids', {'iface-id': '69c97beb-2ba9-428a-abcd-8a17f4bf3c1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:be:e0', 'vm-uuid': '332796aa-adda-40ef-8650-126641e30821'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: INFO os_vif [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=69c97beb-2ba9-428a-abcd-8a17f4bf3c1b,network=Network(a79bd329-e3be-44f3-975e-869368c6b5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c97beb-2b')
Nov 07 04:07:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T04:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583633477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583633477',id=22,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7qsXSGLs+mC92IhCOo9fu/hTPQ5t1+AS7uJm7dv0HXMtIsNXU9ojGEHLtMbGRbnw9Yr5blprgPfBKlEZhTtmiDGlxqbo6WyQ4dq718r+8MLhSRzzyL2Hp9P9gMScDwtA==',key_name='tempest-keypair-1229377363',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ac7b6c7a58f842129f0f27294085214a',ramdisk_id='',reservation_id='r-l9bskaef',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-793581715',owner_user_name='tempest-TaggedAttachmentsTest-793581715-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f469ca83fe184f1698ed812016fb5b64',uuid=332796aa-adda-40ef-8650-126641e30821,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converting VIF {"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=69c97beb-2ba9-428a-abcd-8a17f4bf3c1b,network=Network(a79bd329-e3be-44f3-975e-869368c6b5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c97beb-2b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] attach device xml: <interface type="ethernet">
Nov 07 04:07:38 user nova-compute[74540]:   <mac address="fa:16:3e:cd:be:e0"/>
Nov 07 04:07:38 user nova-compute[74540]:   <model type="virtio"/>
Nov 07 04:07:38 user nova-compute[74540]:   <mtu size="1442"/>
Nov 07 04:07:38 user nova-compute[74540]:   <target dev="tap69c97beb-2b"/>
Nov 07 04:07:38 user nova-compute[74540]: </interface>
Nov 07 04:07:38 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-a6c38176-8347-4a8e-b4c2-4391137d5b76 req-cc6166d5-187a-4753-a4c2-2d6a2e62a6b3 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-vif-plugged-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a6c38176-8347-4a8e-b4c2-4391137d5b76 req-cc6166d5-187a-4753-a4c2-2d6a2e62a6b3 service nova] Acquiring lock "332796aa-adda-40ef-8650-126641e30821-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a6c38176-8347-4a8e-b4c2-4391137d5b76 req-cc6166d5-187a-4753-a4c2-2d6a2e62a6b3 service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a6c38176-8347-4a8e-b4c2-4391137d5b76 req-cc6166d5-187a-4753-a4c2-2d6a2e62a6b3 service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-a6c38176-8347-4a8e-b4c2-4391137d5b76 req-cc6166d5-187a-4753-a4c2-2d6a2e62a6b3 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] No waiting events found dispatching network-vif-plugged-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:39 user nova-compute[74540]: WARNING nova.compute.manager [req-a6c38176-8347-4a8e-b4c2-4391137d5b76 req-cc6166d5-187a-4753-a4c2-2d6a2e62a6b3 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received unexpected event network-vif-plugged-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b for instance with vm_state active and task_state None.
Nov 07 04:07:39 user nova-compute[74540]: DEBUG nova.network.neutron [req-ef13ad2a-1374-4a05-9470-220fa5812ea0 req-8f10813f-289c-4f66-a6ab-fd3b525a11e7 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Updated VIF entry in instance network info cache for port 69c97beb-2ba9-428a-abcd-8a17f4bf3c1b. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG nova.network.neutron [req-ef13ad2a-1374-4a05-9470-220fa5812ea0 req-8f10813f-289c-4f66-a6ab-fd3b525a11e7 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Updating instance_info_cache with network_info: [{"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ef13ad2a-1374-4a05-9470-220fa5812ea0 req-8f10813f-289c-4f66-a6ab-fd3b525a11e7 service nova] Releasing lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] No BDM found with device name hda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] No VIF found with MAC fa:16:3e:2e:77:3f, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-be216c53-ae8c-4818-be95-af4b33473905 req-464f0620-d0fc-45ae-9f70-2e361ac2e006 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received event network-vif-unplugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-be216c53-ae8c-4818-be95-af4b33473905 req-464f0620-d0fc-45ae-9f70-2e361ac2e006 service nova] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-be216c53-ae8c-4818-be95-af4b33473905 req-464f0620-d0fc-45ae-9f70-2e361ac2e006 service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-be216c53-ae8c-4818-be95-af4b33473905 req-464f0620-d0fc-45ae-9f70-2e361ac2e006 service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-be216c53-ae8c-4818-be95-af4b33473905 req-464f0620-d0fc-45ae-9f70-2e361ac2e006 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] No waiting events found dispatching network-vif-unplugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:39 user nova-compute[74540]: WARNING nova.compute.manager [req-be216c53-ae8c-4818-be95-af4b33473905 req-464f0620-d0fc-45ae-9f70-2e361ac2e006 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received unexpected event network-vif-unplugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 for instance with vm_state active and task_state rebuilding.
Nov 07 04:07:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-be216c53-ae8c-4818-be95-af4b33473905 req-464f0620-d0fc-45ae-9f70-2e361ac2e006 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received event network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-be216c53-ae8c-4818-be95-af4b33473905 req-464f0620-d0fc-45ae-9f70-2e361ac2e006 service nova] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-be216c53-ae8c-4818-be95-af4b33473905 req-464f0620-d0fc-45ae-9f70-2e361ac2e006 service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-be216c53-ae8c-4818-be95-af4b33473905 req-464f0620-d0fc-45ae-9f70-2e361ac2e006 service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-be216c53-ae8c-4818-be95-af4b33473905 req-464f0620-d0fc-45ae-9f70-2e361ac2e006 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] No waiting events found dispatching network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:39 user nova-compute[74540]: WARNING nova.compute.manager [req-be216c53-ae8c-4818-be95-af4b33473905 req-464f0620-d0fc-45ae-9f70-2e361ac2e006 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received unexpected event network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 for instance with vm_state active and task_state rebuilding.
Nov 07 04:07:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:07:39 user nova-compute[74540]:   <nova:package version="0.0.0"/>
Nov 07 04:07:39 user nova-compute[74540]:   <nova:name>tempest-device-tagging-server-1583633477</nova:name>
Nov 07 04:07:39 user nova-compute[74540]:   <nova:creationTime>2023-11-07 04:07:39</nova:creationTime>
Nov 07 04:07:39 user nova-compute[74540]:   <nova:flavor name="m1.tiny">
Nov 07 04:07:39 user nova-compute[74540]:     <nova:memory>512</nova:memory>
Nov 07 04:07:39 user nova-compute[74540]:     <nova:disk>1</nova:disk>
Nov 07 04:07:39 user nova-compute[74540]:     <nova:swap>0</nova:swap>
Nov 07 04:07:39 user nova-compute[74540]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:07:39 user nova-compute[74540]:     <nova:vcpus>1</nova:vcpus>
Nov 07 04:07:39 user nova-compute[74540]:   </nova:flavor>
Nov 07 04:07:39 user nova-compute[74540]:   <nova:owner>
Nov 07 04:07:39 user nova-compute[74540]:     <nova:user uuid="f469ca83fe184f1698ed812016fb5b64">tempest-TaggedAttachmentsTest-793581715-project-member</nova:user>
Nov 07 04:07:39 user nova-compute[74540]:     <nova:project uuid="ac7b6c7a58f842129f0f27294085214a">tempest-TaggedAttachmentsTest-793581715</nova:project>
Nov 07 04:07:39 user nova-compute[74540]:   </nova:owner>
Nov 07 04:07:39 user nova-compute[74540]:   <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:07:39 user nova-compute[74540]:   <nova:ports>
Nov 07 04:07:39 user nova-compute[74540]:     <nova:port uuid="abb88c7a-347e-428e-8069-d2419ed701c3">
Nov 07 04:07:39 user nova-compute[74540]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:07:39 user nova-compute[74540]:     </nova:port>
Nov 07 04:07:39 user nova-compute[74540]:     <nova:port uuid="69c97beb-2ba9-428a-abcd-8a17f4bf3c1b">
Nov 07 04:07:39 user nova-compute[74540]:       <nova:ip type="fixed" address="10.10.10.16" ipVersion="4"/>
Nov 07 04:07:39 user nova-compute[74540]:     </nova:port>
Nov 07 04:07:39 user nova-compute[74540]:   </nova:ports>
Nov 07 04:07:39 user nova-compute[74540]: </nova:instance>
Nov 07 04:07:39 user nova-compute[74540]:  {{(pid=74540) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 07 04:07:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-33920634-6f8c-4f23-961f-32ae2b32cdcd tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "interface-332796aa-adda-40ef-8650-126641e30821-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.704s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "332796aa-adda-40ef-8650-126641e30821" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "332796aa-adda-40ef-8650-126641e30821" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG nova.objects.instance [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lazy-loading 'flavor' on Instance uuid 332796aa-adda-40ef-8650-126641e30821 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "332796aa-adda-40ef-8650-126641e30821" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "332796aa-adda-40ef-8650-126641e30821" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "332796aa-adda-40ef-8650-126641e30821" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:40 user nova-compute[74540]: INFO nova.compute.manager [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Attaching volume 1330d631-36c9-4c96-9677-d41e6aaf6ce9 to /dev/vdb
Nov 07 04:07:40 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Instance destroyed successfully.
Nov 07 04:07:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.utils [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b3b689-9c0b-431c-b4d3-45b089b5d5cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d0e00c-32ff-4afd-b084-54fb9fe9f74c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99f9412-506a-452a-a4b0-52d2ff489448]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:40 user nova-compute[74540]: INFO nova.compute.manager [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Detaching volume b195147d-b815-42ae-86a8-6a05a4936814
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f18b5d9-70d8-4e53-9148-7ddaf64673b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:07:40 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b548485d-b386-40a4-ac5a-585cbfd3edbb]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.utils [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Updating existing volume attachment record: 74722d51-fb7a-4732-9908-0748cafde0cf {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:07:40 user nova-compute[74540]: INFO nova.virt.block_device [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Attempting to driver detach volume b195147d-b815-42ae-86a8-6a05a4936814 from mountpoint /dev/vdb
Nov 07 04:07:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Attempting to detach device vdb from instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:07:40 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:07:40 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:07:40 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:07:40 user nova-compute[74540]:   <serial>b195147d-b815-42ae-86a8-6a05a4936814</serial>
Nov 07 04:07:40 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:07:40 user nova-compute[74540]: </disk>
Nov 07 04:07:40 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:40 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully detached device vdb from instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 from the persistent domain config.
Nov 07 04:07:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thiHvNkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:07:40 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[52330c08-9213-4acf-9dbb-8d776081a2f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:07:40 user nova-compute[74540]: No targets found.
Nov 07 04:07:40 user nova-compute[74540]: iSNS:
Nov 07 04:07:40 user nova-compute[74540]: No targets found.
Nov 07 04:07:40 user nova-compute[74540]: STATIC:
Nov 07 04:07:40 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598
Nov 07 04:07:40 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:07:40 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:07:40 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814
Nov 07 04:07:40 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:07:40 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:07:40 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a
Nov 07 04:07:40 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:07:40 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:07:40 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c
Nov 07 04:07:40 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:07:40 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:07:40 user nova-compute[74540]: FIRMWARE:
Nov 07 04:07:40 user nova-compute[74540]: No targets found.
Nov 07 04:07:40 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:07:40 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:07:40 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4e2cc7-22f2-4aba-ae0a-791ca87695d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb0462e-3410-4b80-8be1-97a1fa0d7423]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:40 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:40 user nova-compute[74540]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:07:40 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:07:40 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:40 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:40 user nova-compute[74540]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:07:40 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:07:40 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc388b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814'): ({'sdd'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Removing single pathed devices sdd {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[934caa17-c1cb-43ed-ae96-206325998cb8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3085de-7d69-4b69-a6a0-ce51702b6c35]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flushing IO for device /dev/sdd {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3801613-a237-4404-88e9-41cb94c298be]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89f2765-ced7-401f-b961-3b730632ff1e]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e061b7d9-e780-4561-8320-87e556914cbe]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-e731c442-320e-428a-95d6-1b6c51491663 req-db1492a2-4df6-44a1-bdd3-b988f5448910 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-vif-plugged-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e731c442-320e-428a-95d6-1b6c51491663 req-db1492a2-4df6-44a1-bdd3-b988f5448910 service nova] Acquiring lock "332796aa-adda-40ef-8650-126641e30821-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e731c442-320e-428a-95d6-1b6c51491663 req-db1492a2-4df6-44a1-bdd3-b988f5448910 service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e731c442-320e-428a-95d6-1b6c51491663 req-db1492a2-4df6-44a1-bdd3-b988f5448910 service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-e731c442-320e-428a-95d6-1b6c51491663 req-db1492a2-4df6-44a1-bdd3-b988f5448910 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] No waiting events found dispatching network-vif-plugged-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:41 user nova-compute[74540]: WARNING nova.compute.manager [req-e731c442-320e-428a-95d6-1b6c51491663 req-db1492a2-4df6-44a1-bdd3-b988f5448910 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received unexpected event network-vif-plugged-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b for instance with vm_state active and task_state None.
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a743afe-1979-4ae6-9eef-7ad9b5a409d1]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260]
Nov 07 04:07:41 user nova-compute[74540]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260] successful.
Nov 07 04:07:41 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2730b1d-93c7-4922-9fa6-b136ff4038fc]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== disconnect_volume: return (394ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] No waiting events found dispatching network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:41 user nova-compute[74540]: WARNING nova.compute.manager [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received unexpected event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 for instance with vm_state active and task_state rescuing.
Nov 07 04:07:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] No waiting events found dispatching network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:41 user nova-compute[74540]: WARNING nova.compute.manager [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received unexpected event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 for instance with vm_state active and task_state rescuing.
Nov 07 04:07:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] No waiting events found dispatching network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:41 user nova-compute[74540]: WARNING nova.compute.manager [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received unexpected event network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba for instance with vm_state shelved_offloaded and task_state spawning.
Nov 07 04:07:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] No waiting events found dispatching network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:07:41 user nova-compute[74540]: WARNING nova.compute.manager [req-8dd69d1b-f3df-44df-82e9-af3c1927ce8f req-44baee43-fafb-4815-a6b7-eb224a285f94 service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received unexpected event network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba for instance with vm_state shelved_offloaded and task_state spawning.
Nov 07 04:07:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Instance destroyed successfully.
Nov 07 04:07:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-905638517',display_name='tempest-ServerActionsTestOtherA-server-612150756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-905638517',id=21,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnVI6gwzel5Ql/BuaLSS3BsMPir/RBkcVGKmw5hj9mqhnJPLS6fivjrEUdxmnvOsXyWSIwfONC16BOCTgU/hkRjILu4a9Q61a1FizttTQVjvxUM6qM6uvcsjWMI5HVtcA==',key_name='tempest-keypair-1497340994',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:05:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-hs9y32ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:07:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=74271ad1-5dc8-4f92-83cf-4f31d05b0dd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_vif [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32b18c39-92, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=466e9112-e5f5-4b4b-a3c3-2cbe06de91b2) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:42 user nova-compute[74540]: INFO os_vif [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92')
Nov 07 04:07:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thiHvNkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:07:42 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1233e3f7-129a-4b6f-a741-a318091be74a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:07:42 user nova-compute[74540]: No targets found.
Nov 07 04:07:42 user nova-compute[74540]: iSNS:
Nov 07 04:07:42 user nova-compute[74540]: No targets found.
Nov 07 04:07:42 user nova-compute[74540]: STATIC:
Nov 07 04:07:42 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598
Nov 07 04:07:42 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:07:42 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:07:42 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a
Nov 07 04:07:42 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:07:42 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:07:42 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c
Nov 07 04:07:42 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:07:42 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:07:42 user nova-compute[74540]: FIRMWARE:
Nov 07 04:07:42 user nova-compute[74540]: No targets found.
Nov 07 04:07:42 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:07:42 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:07:42 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f5311f-9c76-4d5d-953d-8a318771b416]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[da62904b-bf1c-4fbd-8d4a-9e48d453e1f2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:42 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:42 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:07:42 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:07:42 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:07:42 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:07:42 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc3f5d80>, {}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Disconnecting from: [] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== disconnect_volume: return (84ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:07:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Deleting instance files /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6_del
Nov 07 04:07:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Deletion of /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6_del complete
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:42 user nova-compute[74540]: INFO nova.virt.block_device [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Booting with volume b195147d-b815-42ae-86a8-6a05a4936814 at /dev/vdb
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.utils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[084fd7cb-f13c-444a-a941-29fc69a0a557]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd26e5e-b013-45a4-9807-9b981a7cdbf2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a746f9-9bcb-49b0-a557-d6e8ee98d4e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa683d9-84a4-422b-8f4c-a3d9ca3c32ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:07:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:07:43 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:07:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[67debf7a-80de-4f1c-a84f-d3614438c271]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG os_brick.utils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== get_connector_properties: return (193ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Updating existing volume attachment record: 83e9d5fd-162e-4356-94b6-c5f1390c3cbc {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6301cef6-832c-4068-899c-13bd6c43b804 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:07:43 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Instance spawned successfully.
Nov 07 04:07:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:07:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:07:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c035d42d-9f2f-44f8-9284-4fa1e290c31b tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 63.370s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:45 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid '74271ad1-5dc8-4f92-83cf-4f31d05b0dd6' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid '74271ad1-5dc8-4f92-83cf-4f31d05b0dd6' (instance-00000015)
Nov 07 04:07:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:07:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:07:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.334s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:07:48 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:07:48 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7970MB free_disk=25.02922821044922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d61ec49c-3345-4808-bfcd-a9d925fe1918 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 332796aa-adda-40ef-8650-126641e30821 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6b84cdaa-6964-4e16-95b3-accb9086d871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing inventories for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating ProviderTree inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 04:07:48 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 04:07:49 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing aggregate associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, aggregates: None {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 04:07:49 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing trait associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 04:07:49 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:07:49 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:07:49 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:07:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.382s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:07:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:07:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:07:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:07:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:07:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:07:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:07:51 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updating instance_info_cache with network_info: [{"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:07:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-6b84cdaa-6964-4e16-95b3-accb9086d871" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:07:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:07:51 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:07:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:07:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:07:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:10 user nova-compute[74540]: DEBUG nova.objects.instance [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:08:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquired lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:08:10 user nova-compute[74540]: DEBUG nova.network.neutron [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:08:10 user nova-compute[74540]: DEBUG nova.objects.instance [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'info_cache' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:10 user nova-compute[74540]: DEBUG nova.objects.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:08:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:10 user nova-compute[74540]: DEBUG nova.network.neutron [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updating instance_info_cache with network_info: [{"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:08:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Releasing lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:08:10 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance destroyed successfully.
Nov 07 04:08:10 user nova-compute[74540]: DEBUG nova.objects.instance [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'resources' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.objects.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911941987',display_name='tempest-AttachVolumeTestJSON-server-1911941987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911941987',id=18,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZc0H8u9Sjs7UCPrYgQ/YYzLFW938ISChSSmxmxSC0YJVGNn+t+64OY9nQmYmr4BRKTp4XCwtT9CfL/C0bBD3MbQluNfqx9UtboWoTJuQ/vtZlZuy9FmbFmNS0Ski8AxQ==',key_name='tempest-keypair-1685201050',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='513e7858a1b34aa2bd5f363696b38f0a',ramdisk_id='',reservation_id='r-3y9w8i3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-540287196',owner_user_name='tempest-AttachVolumeTestJSON-540287196-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='791771e33e0645d6b97cef52f84d8b9c',uuid=80624b0b-4c6b-4d6f-9d31-2f7c81e39c79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converting VIF {"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_vif [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap134a19cd-7f, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1962f8a-0dec-46de-b76e-18120ea8e9b3) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:08:11 user nova-compute[74540]: INFO os_vif [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f')
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sblqKIDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:08:11 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e25afd-c20f-4020-b067-2e99e845e6ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:08:11 user nova-compute[74540]: No targets found.
Nov 07 04:08:11 user nova-compute[74540]: iSNS:
Nov 07 04:08:11 user nova-compute[74540]: No targets found.
Nov 07 04:08:11 user nova-compute[74540]: STATIC:
Nov 07 04:08:11 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598
Nov 07 04:08:11 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:08:11 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:08:11 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a
Nov 07 04:08:11 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:08:11 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:08:11 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c
Nov 07 04:08:11 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:08:11 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:08:11 user nova-compute[74540]: FIRMWARE:
Nov 07 04:08:11 user nova-compute[74540]: No targets found.
Nov 07 04:08:11 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:08:11 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:08:11 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ba9d5-02bd-4ba0-b8fa-9580c6f1f113]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee63c09-3c4d-4df6-a97c-69ea4aa44f82]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:11 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:11 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:11 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:11 user nova-compute[74540]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:11 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:11 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc39d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dddea09-1ca4-4d58-8ba3-3a044db515ef]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9625c1c-e5e5-476a-8cdc-1b4f5077aa1a]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1c132f-7ad3-482f-808e-7848f137b82b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[04827ddc-4acd-44ab-889f-c3c8b5077614]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e73eb5-4a6c-4bfd-b07e-4b07d2857bab]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[577a6b1d-03d0-4c5f-a932-3854818699ff]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260]
Nov 07 04:08:11 user nova-compute[74540]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260] successful.
Nov 07 04:08:11 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c1fa87-c1eb-4c10-a3fe-8f9c54da061a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] <== disconnect_volume: return (369ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Start _get_guest_xml network_info=[{"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sblqKIDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '80624b0b-4c6b-4d6f-9d31-2f7c81e39c79', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3225410-ef51-46ce-b9a3-2cdd6e153598', 'serial': 'c3225410-ef51-46ce-b9a3-2cdd6e153598'}, 'boot_index': None, 'attachment_id': '43aa6e6d-7036-4e13-b952-0a05429867e3', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.objects.instance [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'numa_topology' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:08:11 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Creating image(s)
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "/opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "/opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "/opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.objects.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:08:11 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.objects.instance [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.objects.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sblqKIDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:08:11 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:08:11 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:08:11 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5272267-6e1b-4cf3-b5cb-dbdd1598377d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:08:11 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6efa1d-c952-4a8c-82ac-0a11eb21d6ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598] added
Nov 07 04:08:11 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2f964a-e608-41ed-8391-c88cb539f82a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a940cc1-4bce-45b2-b4cb-cc12ebe8e5e8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sblqKIDa {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sblqKIDa" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd21ebe-6419-4a4b-abd6-ab3d43a3a261]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sblqKIDa'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b49c355-ac09-461d-b1e7-eac1417864da]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e360dbaa-6e04-42c8-b5b2-f1f86d196909]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:11 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:11 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:11 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:11 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk 1073741824" returned: 0 in 0.054s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a21696-4dfa-4343-aa46-95c004806284]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260]
Nov 07 04:08:11 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260] successful.
Nov 07 04:08:11 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c10c8e-8e31-4bef-bdce-148d8e1874c4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f433ad71-9150-4c9a-bd88-b861dbfd9b01]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:12 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:12 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:12 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:12 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:12 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:12 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcf41b7-995c-4f4d-b4e9-6e87124d1891]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sblqKIDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Cannot resize image /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Ensure instance console log exists: /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Start _get_guest_xml network_info=[{"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thiHvNkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '74271ad1-5dc8-4f92-83cf-4f31d05b0dd6', 'attached_at': '', 'detached_at': '', 'volume_id': 'b195147d-b815-42ae-86a8-6a05a4936814', 'serial': 'b195147d-b815-42ae-86a8-6a05a4936814'}, 'boot_index': None, 'attachment_id': '83e9d5fd-162e-4356-94b6-c5f1390c3cbc', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:08:12 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 07 04:08:12 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lazy-loading 'vcpu_model' on Instance uuid 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:08:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thiHvNkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:08:12 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 07 04:08:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23036636237623738', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036636237623738', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.639s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:08:13 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:08:13 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc44f529-2ba1-4a41-9628-6adda2ac58fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:08:13 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911941987',display_name='tempest-AttachVolumeTestJSON-server-1911941987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911941987',id=18,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZc0H8u9Sjs7UCPrYgQ/YYzLFW938ISChSSmxmxSC0YJVGNn+t+64OY9nQmYmr4BRKTp4XCwtT9CfL/C0bBD3MbQluNfqx9UtboWoTJuQ/vtZlZuy9FmbFmNS0Ski8AxQ==',key_name='tempest-keypair-1685201050',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='513e7858a1b34aa2bd5f363696b38f0a',ramdisk_id='',reservation_id='r-3y9w8i3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-540287196',owner_user_name='tempest-AttachVolumeTestJSON-540287196-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='791771e33e0645d6b97cef52f84d8b9c',uuid=80624b0b-4c6b-4d6f-9d31-2f7c81e39c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converting VIF {"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG nova.objects.instance [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'pci_devices' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d38dfba-82e2-4b40-8df3-677a75dec13a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814] added
Nov 07 04:08:13 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG nova.objects.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:08:13 user nova-compute[74540]:   <uuid>80624b0b-4c6b-4d6f-9d31-2f7c81e39c79</uuid>
Nov 07 04:08:13 user nova-compute[74540]:   <name>instance-00000012</name>
Nov 07 04:08:13 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:08:13 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:08:13 user nova-compute[74540]:   <metadata>
Nov 07 04:08:13 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:08:13 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:08:13 user nova-compute[74540]:       <nova:name>tempest-AttachVolumeTestJSON-server-1911941987</nova:name>
Nov 07 04:08:13 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:08:11</nova:creationTime>
Nov 07 04:08:13 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:08:13 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:08:13 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:08:13 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:08:13 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:08:13 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:08:13 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:08:13 user nova-compute[74540]:       <nova:owner>
Nov 07 04:08:13 user nova-compute[74540]:         <nova:user uuid="791771e33e0645d6b97cef52f84d8b9c">tempest-AttachVolumeTestJSON-540287196-project-member</nova:user>
Nov 07 04:08:13 user nova-compute[74540]:         <nova:project uuid="513e7858a1b34aa2bd5f363696b38f0a">tempest-AttachVolumeTestJSON-540287196</nova:project>
Nov 07 04:08:13 user nova-compute[74540]:       </nova:owner>
Nov 07 04:08:13 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:08:13 user nova-compute[74540]:       <nova:ports>
Nov 07 04:08:13 user nova-compute[74540]:         <nova:port uuid="134a19cd-7f72-44e1-82c0-5ffab04d98b6">
Nov 07 04:08:13 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 04:08:13 user nova-compute[74540]:         </nova:port>
Nov 07 04:08:13 user nova-compute[74540]:       </nova:ports>
Nov 07 04:08:13 user nova-compute[74540]:     </nova:instance>
Nov 07 04:08:13 user nova-compute[74540]:   </metadata>
Nov 07 04:08:13 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:08:13 user nova-compute[74540]:     <system>
Nov 07 04:08:13 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:08:13 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:08:13 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:08:13 user nova-compute[74540]:       <entry name="serial">80624b0b-4c6b-4d6f-9d31-2f7c81e39c79</entry>
Nov 07 04:08:13 user nova-compute[74540]:       <entry name="uuid">80624b0b-4c6b-4d6f-9d31-2f7c81e39c79</entry>
Nov 07 04:08:13 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:08:13 user nova-compute[74540]:     </system>
Nov 07 04:08:13 user nova-compute[74540]:   </sysinfo>
Nov 07 04:08:13 user nova-compute[74540]:   <os>
Nov 07 04:08:13 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:08:13 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:08:13 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:08:13 user nova-compute[74540]:   </os>
Nov 07 04:08:13 user nova-compute[74540]:   <features>
Nov 07 04:08:13 user nova-compute[74540]:     <acpi/>
Nov 07 04:08:13 user nova-compute[74540]:     <apic/>
Nov 07 04:08:13 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:08:13 user nova-compute[74540]:   </features>
Nov 07 04:08:13 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:08:13 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:08:13 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:08:13 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:08:13 user nova-compute[74540]:   </clock>
Nov 07 04:08:13 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:08:13 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:08:13 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:08:13 user nova-compute[74540]:   </cpu>
Nov 07 04:08:13 user nova-compute[74540]:   <devices>
Nov 07 04:08:13 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:08:13 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:08:13 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk"/>
Nov 07 04:08:13 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:08:13 user nova-compute[74540]:     </disk>
Nov 07 04:08:13 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:08:13 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:08:13 user nova-compute[74540]:       <source dev="/dev/sdb"/>
Nov 07 04:08:13 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 04:08:13 user nova-compute[74540]:       <serial>c3225410-ef51-46ce-b9a3-2cdd6e153598</serial>
Nov 07 04:08:13 user nova-compute[74540]:     </disk>
Nov 07 04:08:13 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:08:13 user nova-compute[74540]:       <mac address="fa:16:3e:53:d9:ef"/>
Nov 07 04:08:13 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:08:13 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:08:13 user nova-compute[74540]:       <target dev="tap134a19cd-7f"/>
Nov 07 04:08:13 user nova-compute[74540]:     </interface>
Nov 07 04:08:13 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:08:13 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/console.log" append="off"/>
Nov 07 04:08:13 user nova-compute[74540]:     </serial>
Nov 07 04:08:13 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:08:13 user nova-compute[74540]:     <video>
Nov 07 04:08:13 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:08:13 user nova-compute[74540]:     </video>
Nov 07 04:08:13 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:08:13 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:08:13 user nova-compute[74540]:     </rng>
Nov 07 04:08:13 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:08:13 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:08:13 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:08:13 user nova-compute[74540]:     </memballoon>
Nov 07 04:08:13 user nova-compute[74540]:   </devices>
Nov 07 04:08:13 user nova-compute[74540]: </domain>
Nov 07 04:08:13 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[921f04a5-0a70-442d-afcb-0a772b3ba622]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[535443c1-7e60-45fe-8e61-eaa54f6cd46e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v thiHvNkD {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v thiHvNkD" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[265e05e8-06bc-4705-a089-7e637fe6fa21]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'thiHvNkD'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2247542f-8236-4219-aaad-1df44ec29e75]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0866f-04b5-426a-a2c7-86da7672bc25]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:13 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:13 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:13 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:13 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:13 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:13 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d470bbf-7ae9-4596-843f-e03e2b3d7f73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260]
Nov 07 04:08:13 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260] successful.
Nov 07 04:08:13 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45a3aa4-d0a8-4dd8-95be-fa468387f4bf]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b5d707-b09a-4a91-afbf-303ac6a3752b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:13 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:13 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:13 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:08:13 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:13 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:13 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:13 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:08:13 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[26155f48-1bdf-4f2d-9040-cb8b73a8d74a]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thiHvNkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG nova.objects.instance [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG nova.objects.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.214s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:08:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Cannot resize image /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.objects.instance [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'migration_context' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.objects.base [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911941987',display_name='tempest-AttachVolumeTestJSON-server-1911941987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911941987',id=18,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZc0H8u9Sjs7UCPrYgQ/YYzLFW938ISChSSmxmxSC0YJVGNn+t+64OY9nQmYmr4BRKTp4XCwtT9CfL/C0bBD3MbQluNfqx9UtboWoTJuQ/vtZlZuy9FmbFmNS0Ski8AxQ==',key_name='tempest-keypair-1685201050',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='513e7858a1b34aa2bd5f363696b38f0a',ramdisk_id='',reservation_id='r-3y9w8i3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-540287196',owner_user_name='tempest-AttachVolumeTestJSON-540287196-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='791771e33e0645d6b97cef52f84d8b9c',uuid=80624b0b-4c6b-4d6f-9d31-2f7c81e39c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converting VIF {"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG os_vif [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcc936cd-f2bc-5060-88af-a79f2136c4ca', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap134a19cd-7f, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap134a19cd-7f, col_values=(('qos', UUID('3dc19364-0237-4ccd-9ead-c2134352a25b')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap134a19cd-7f, col_values=(('external_ids', {'iface-id': '134a19cd-7f72-44e1-82c0-5ffab04d98b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:d9:ef', 'vm-uuid': '80624b0b-4c6b-4d6f-9d31-2f7c81e39c79'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: INFO os_vif [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f')
Nov 07 04:08:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== connect_volume: return (2057ms) {'type': 'block', 'scsi_wwn': '23036306530393234', 'path': '/dev/sdd'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036306530393234', 'path': '/dev/sdd'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T04:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-905638517',display_name='tempest-ServerActionsTestOtherA-server-612150756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-905638517',id=21,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnVI6gwzel5Ql/BuaLSS3BsMPir/RBkcVGKmw5hj9mqhnJPLS6fivjrEUdxmnvOsXyWSIwfONC16BOCTgU/hkRjILu4a9Q61a1FizttTQVjvxUM6qM6uvcsjWMI5HVtcA==',key_name='tempest-keypair-1497340994',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:05:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-hs9y32ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=74271ad1-5dc8-4f92-83cf-4f31d05b0dd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:08:14 user nova-compute[74540]:   <uuid>74271ad1-5dc8-4f92-83cf-4f31d05b0dd6</uuid>
Nov 07 04:08:14 user nova-compute[74540]:   <name>instance-00000015</name>
Nov 07 04:08:14 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:08:14 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:08:14 user nova-compute[74540]:   <metadata>
Nov 07 04:08:14 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:08:14 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:08:14 user nova-compute[74540]:       <nova:name>tempest-ServerActionsTestOtherA-server-612150756</nova:name>
Nov 07 04:08:14 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:08:12</nova:creationTime>
Nov 07 04:08:14 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:08:14 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:08:14 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:08:14 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:08:14 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:08:14 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:08:14 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:08:14 user nova-compute[74540]:       <nova:owner>
Nov 07 04:08:14 user nova-compute[74540]:         <nova:user uuid="bd0ca1c305c04866b3323a98c6796ded">tempest-ServerActionsTestOtherA-28801548-project-member</nova:user>
Nov 07 04:08:14 user nova-compute[74540]:         <nova:project uuid="04e4bbbf680d48fe8534c9ebe909fd50">tempest-ServerActionsTestOtherA-28801548</nova:project>
Nov 07 04:08:14 user nova-compute[74540]:       </nova:owner>
Nov 07 04:08:14 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:08:14 user nova-compute[74540]:       <nova:ports>
Nov 07 04:08:14 user nova-compute[74540]:         <nova:port uuid="32b18c39-92d0-488b-891e-fd7b5f9b85d1">
Nov 07 04:08:14 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 07 04:08:14 user nova-compute[74540]:         </nova:port>
Nov 07 04:08:14 user nova-compute[74540]:       </nova:ports>
Nov 07 04:08:14 user nova-compute[74540]:     </nova:instance>
Nov 07 04:08:14 user nova-compute[74540]:   </metadata>
Nov 07 04:08:14 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:08:14 user nova-compute[74540]:     <system>
Nov 07 04:08:14 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:08:14 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:08:14 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:08:14 user nova-compute[74540]:       <entry name="serial">74271ad1-5dc8-4f92-83cf-4f31d05b0dd6</entry>
Nov 07 04:08:14 user nova-compute[74540]:       <entry name="uuid">74271ad1-5dc8-4f92-83cf-4f31d05b0dd6</entry>
Nov 07 04:08:14 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:08:14 user nova-compute[74540]:     </system>
Nov 07 04:08:14 user nova-compute[74540]:   </sysinfo>
Nov 07 04:08:14 user nova-compute[74540]:   <os>
Nov 07 04:08:14 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:08:14 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:08:14 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:08:14 user nova-compute[74540]:   </os>
Nov 07 04:08:14 user nova-compute[74540]:   <features>
Nov 07 04:08:14 user nova-compute[74540]:     <acpi/>
Nov 07 04:08:14 user nova-compute[74540]:     <apic/>
Nov 07 04:08:14 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:08:14 user nova-compute[74540]:   </features>
Nov 07 04:08:14 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:08:14 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:08:14 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:08:14 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:08:14 user nova-compute[74540]:   </clock>
Nov 07 04:08:14 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:08:14 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:08:14 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:08:14 user nova-compute[74540]:   </cpu>
Nov 07 04:08:14 user nova-compute[74540]:   <devices>
Nov 07 04:08:14 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:08:14 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:08:14 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk"/>
Nov 07 04:08:14 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:08:14 user nova-compute[74540]:     </disk>
Nov 07 04:08:14 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:08:14 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:08:14 user nova-compute[74540]:       <source dev="/dev/sdd"/>
Nov 07 04:08:14 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 04:08:14 user nova-compute[74540]:       <serial>b195147d-b815-42ae-86a8-6a05a4936814</serial>
Nov 07 04:08:14 user nova-compute[74540]:     </disk>
Nov 07 04:08:14 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:08:14 user nova-compute[74540]:       <mac address="fa:16:3e:21:1b:68"/>
Nov 07 04:08:14 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:08:14 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:08:14 user nova-compute[74540]:       <target dev="tap32b18c39-92"/>
Nov 07 04:08:14 user nova-compute[74540]:     </interface>
Nov 07 04:08:14 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:08:14 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/console.log" append="off"/>
Nov 07 04:08:14 user nova-compute[74540]:     </serial>
Nov 07 04:08:14 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:08:14 user nova-compute[74540]:     <video>
Nov 07 04:08:14 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:08:14 user nova-compute[74540]:     </video>
Nov 07 04:08:14 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:08:14 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:08:14 user nova-compute[74540]:     </rng>
Nov 07 04:08:14 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:08:14 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:08:14 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:08:14 user nova-compute[74540]:     </memballoon>
Nov 07 04:08:14 user nova-compute[74540]:   </devices>
Nov 07 04:08:14 user nova-compute[74540]: </domain>
Nov 07 04:08:14 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T04:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-905638517',display_name='tempest-ServerActionsTestOtherA-server-612150756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-905638517',id=21,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnVI6gwzel5Ql/BuaLSS3BsMPir/RBkcVGKmw5hj9mqhnJPLS6fivjrEUdxmnvOsXyWSIwfONC16BOCTgU/hkRjILu4a9Q61a1FizttTQVjvxUM6qM6uvcsjWMI5HVtcA==',key_name='tempest-keypair-1497340994',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:05:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-hs9y32ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=74271ad1-5dc8-4f92-83cf-4f31d05b0dd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG os_vif [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebfa8a40-a0b9-50f8-924c-8aa0f34c9011', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32b18c39-92, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32b18c39-92, col_values=(('qos', UUID('308db024-3609-42e2-9714-a75d6e1ff056')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32b18c39-92, col_values=(('external_ids', {'iface-id': '32b18c39-92d0-488b-891e-fd7b5f9b85d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:1b:68', 'vm-uuid': '74271ad1-5dc8-4f92-83cf-4f31d05b0dd6'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:14 user nova-compute[74540]: INFO os_vif [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92')
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:08:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No VIF found with MAC fa:16:3e:21:1b:68, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:08:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:16 user nova-compute[74540]: DEBUG nova.compute.manager [req-b05aa76b-895a-492d-9e3f-294a2a8b16e6 req-e90beed9-34ea-4814-a71c-cf957ef1999e service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:08:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b05aa76b-895a-492d-9e3f-294a2a8b16e6 req-e90beed9-34ea-4814-a71c-cf957ef1999e service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b05aa76b-895a-492d-9e3f-294a2a8b16e6 req-e90beed9-34ea-4814-a71c-cf957ef1999e service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b05aa76b-895a-492d-9e3f-294a2a8b16e6 req-e90beed9-34ea-4814-a71c-cf957ef1999e service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:16 user nova-compute[74540]: DEBUG nova.compute.manager [req-b05aa76b-895a-492d-9e3f-294a2a8b16e6 req-e90beed9-34ea-4814-a71c-cf957ef1999e service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:08:16 user nova-compute[74540]: WARNING nova.compute.manager [req-b05aa76b-895a-492d-9e3f-294a2a8b16e6 req-e90beed9-34ea-4814-a71c-cf957ef1999e service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state stopped and task_state powering-on.
Nov 07 04:08:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-736d44a6-8ec8-4533-a614-5303cb51d418 req-0942ca70-ef74-4d33-8315-508f3e4cc9c9 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received event network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:08:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-736d44a6-8ec8-4533-a614-5303cb51d418 req-0942ca70-ef74-4d33-8315-508f3e4cc9c9 service nova] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-736d44a6-8ec8-4533-a614-5303cb51d418 req-0942ca70-ef74-4d33-8315-508f3e4cc9c9 service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-736d44a6-8ec8-4533-a614-5303cb51d418 req-0942ca70-ef74-4d33-8315-508f3e4cc9c9 service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-736d44a6-8ec8-4533-a614-5303cb51d418 req-0942ca70-ef74-4d33-8315-508f3e4cc9c9 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] No waiting events found dispatching network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:08:17 user nova-compute[74540]: WARNING nova.compute.manager [req-736d44a6-8ec8-4533-a614-5303cb51d418 req-0942ca70-ef74-4d33-8315-508f3e4cc9c9 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received unexpected event network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 for instance with vm_state active and task_state rebuild_spawning.
Nov 07 04:08:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-66793b8e-c6df-43a8-833e-6c62aa027df1 req-af084baf-acfa-4cf3-b75c-190c36a1e7c7 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:08:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-66793b8e-c6df-43a8-833e-6c62aa027df1 req-af084baf-acfa-4cf3-b75c-190c36a1e7c7 service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-66793b8e-c6df-43a8-833e-6c62aa027df1 req-af084baf-acfa-4cf3-b75c-190c36a1e7c7 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-66793b8e-c6df-43a8-833e-6c62aa027df1 req-af084baf-acfa-4cf3-b75c-190c36a1e7c7 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-66793b8e-c6df-43a8-833e-6c62aa027df1 req-af084baf-acfa-4cf3-b75c-190c36a1e7c7 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:08:18 user nova-compute[74540]: WARNING nova.compute.manager [req-66793b8e-c6df-43a8-833e-6c62aa027df1 req-af084baf-acfa-4cf3-b75c-190c36a1e7c7 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state stopped and task_state powering-on.
Nov 07 04:08:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-268a4041-75c3-44b4-ad29-f00892802040 req-825daf4f-74cd-4ba7-b6f6-4ef3a089a042 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received event network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-268a4041-75c3-44b4-ad29-f00892802040 req-825daf4f-74cd-4ba7-b6f6-4ef3a089a042 service nova] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-268a4041-75c3-44b4-ad29-f00892802040 req-825daf4f-74cd-4ba7-b6f6-4ef3a089a042 service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-268a4041-75c3-44b4-ad29-f00892802040 req-825daf4f-74cd-4ba7-b6f6-4ef3a089a042 service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-268a4041-75c3-44b4-ad29-f00892802040 req-825daf4f-74cd-4ba7-b6f6-4ef3a089a042 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] No waiting events found dispatching network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:08:19 user nova-compute[74540]: WARNING nova.compute.manager [req-268a4041-75c3-44b4-ad29-f00892802040 req-825daf4f-74cd-4ba7-b6f6-4ef3a089a042 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received unexpected event network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 for instance with vm_state active and task_state rebuild_spawning.
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:08:19 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Instance spawned successfully.
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:08:19 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance rebooted successfully.
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-37ae8066-363a-47a9-a4c6-fb5c3f23e195 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74540) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 07 04:08:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e9cecfc7-f844-4c36-a298-a83dd381fb2a tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:08:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:08:23 user nova-compute[74540]: INFO nova.compute.claims [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Claim successful on node user
Nov 07 04:08:24 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:08:24 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:08:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:08:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:08:24 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:08:24 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:08:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:08:24 user nova-compute[74540]: DEBUG nova.policy [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3079ba3a84ea4b4bb4a3e576ab4133ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620cefdadcec49d6a696aa7db8cef2d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:08:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:08:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:08:24 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Creating image(s)
Nov 07 04:08:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "/opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "/opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:24 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.243s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.237s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk 1073741824" returned: 0 in 0.074s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Successfully created port: 68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.255s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Cannot resize image /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Ensure instance console log exists: /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Successfully updated port: 68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "refresh_cache-5d120b2b-8d1b-4d19-8364-ab4dad61bad3" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquired lock "refresh_cache-5d120b2b-8d1b-4d19-8364-ab4dad61bad3" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c9c2412-d884-4cdd-b3ed-29a732bf06e9 req-ea9e953f-3ad4-4a69-990c-726fd6585ec8 service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Received event network-changed-68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c9c2412-d884-4cdd-b3ed-29a732bf06e9 req-ea9e953f-3ad4-4a69-990c-726fd6585ec8 service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Refreshing instance network info cache due to event network-changed-68a8f22b-c3f1-4575-b2f3-29af6c59af12. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c9c2412-d884-4cdd-b3ed-29a732bf06e9 req-ea9e953f-3ad4-4a69-990c-726fd6585ec8 service nova] Acquiring lock "refresh_cache-5d120b2b-8d1b-4d19-8364-ab4dad61bad3" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Updating instance_info_cache with network_info: [{"id": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "address": "fa:16:3e:f7:9f:73", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a8f22b-c3", "ovs_interfaceid": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Releasing lock "refresh_cache-5d120b2b-8d1b-4d19-8364-ab4dad61bad3" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Instance network_info: |[{"id": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "address": "fa:16:3e:f7:9f:73", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a8f22b-c3", "ovs_interfaceid": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c9c2412-d884-4cdd-b3ed-29a732bf06e9 req-ea9e953f-3ad4-4a69-990c-726fd6585ec8 service nova] Acquired lock "refresh_cache-5d120b2b-8d1b-4d19-8364-ab4dad61bad3" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.network.neutron [req-1c9c2412-d884-4cdd-b3ed-29a732bf06e9 req-ea9e953f-3ad4-4a69-990c-726fd6585ec8 service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Refreshing network info cache for port 68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Start _get_guest_xml network_info=[{"id": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "address": "fa:16:3e:f7:9f:73", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a8f22b-c3", "ovs_interfaceid": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:08:26 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:08:26 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1772667439',display_name='tempest-AttachVolumeNegativeTest-server-1772667439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1772667439',id=24,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANZIRK0djzkHWUv72oPiNJN+/Z03DvhkpML1H24uDTtZ9wofEjnoeD1A/JIq2OWLCdMQuoS7KxQ2nTwhxDaAE2IwBppbST8e/3+cnZgkSJAT/BuHuxadAAsqNCaLwBFCA==',key_name='tempest-keypair-310613541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='620cefdadcec49d6a696aa7db8cef2d1',ramdisk_id='',reservation_id='r-sqydcp6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-306463361',owner_user_name='tempest-AttachVolumeNegativeTest-306463361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:08:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3079ba3a84ea4b4bb4a3e576ab4133ae',uuid=5d120b2b-8d1b-4d19-8364-ab4dad61bad3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "address": "fa:16:3e:f7:9f:73", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a8f22b-c3", "ovs_interfaceid": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converting VIF {"id": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "address": "fa:16:3e:f7:9f:73", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a8f22b-c3", "ovs_interfaceid": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=68a8f22b-c3f1-4575-b2f3-29af6c59af12,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a8f22b-c3') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:08:26 user nova-compute[74540]:   <uuid>5d120b2b-8d1b-4d19-8364-ab4dad61bad3</uuid>
Nov 07 04:08:26 user nova-compute[74540]:   <name>instance-00000018</name>
Nov 07 04:08:26 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:08:26 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:08:26 user nova-compute[74540]:   <metadata>
Nov 07 04:08:26 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:08:26 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:08:26 user nova-compute[74540]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1772667439</nova:name>
Nov 07 04:08:26 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:08:26</nova:creationTime>
Nov 07 04:08:26 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:08:26 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:08:26 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:08:26 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:08:26 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:08:26 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:08:26 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:08:26 user nova-compute[74540]:       <nova:owner>
Nov 07 04:08:26 user nova-compute[74540]:         <nova:user uuid="3079ba3a84ea4b4bb4a3e576ab4133ae">tempest-AttachVolumeNegativeTest-306463361-project-member</nova:user>
Nov 07 04:08:26 user nova-compute[74540]:         <nova:project uuid="620cefdadcec49d6a696aa7db8cef2d1">tempest-AttachVolumeNegativeTest-306463361</nova:project>
Nov 07 04:08:26 user nova-compute[74540]:       </nova:owner>
Nov 07 04:08:26 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:08:26 user nova-compute[74540]:       <nova:ports>
Nov 07 04:08:26 user nova-compute[74540]:         <nova:port uuid="68a8f22b-c3f1-4575-b2f3-29af6c59af12">
Nov 07 04:08:26 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 07 04:08:26 user nova-compute[74540]:         </nova:port>
Nov 07 04:08:26 user nova-compute[74540]:       </nova:ports>
Nov 07 04:08:26 user nova-compute[74540]:     </nova:instance>
Nov 07 04:08:26 user nova-compute[74540]:   </metadata>
Nov 07 04:08:26 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:08:26 user nova-compute[74540]:     <system>
Nov 07 04:08:26 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:08:26 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:08:26 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:08:26 user nova-compute[74540]:       <entry name="serial">5d120b2b-8d1b-4d19-8364-ab4dad61bad3</entry>
Nov 07 04:08:26 user nova-compute[74540]:       <entry name="uuid">5d120b2b-8d1b-4d19-8364-ab4dad61bad3</entry>
Nov 07 04:08:26 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:08:26 user nova-compute[74540]:     </system>
Nov 07 04:08:26 user nova-compute[74540]:   </sysinfo>
Nov 07 04:08:26 user nova-compute[74540]:   <os>
Nov 07 04:08:26 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:08:26 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:08:26 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:08:26 user nova-compute[74540]:   </os>
Nov 07 04:08:26 user nova-compute[74540]:   <features>
Nov 07 04:08:26 user nova-compute[74540]:     <acpi/>
Nov 07 04:08:26 user nova-compute[74540]:     <apic/>
Nov 07 04:08:26 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:08:26 user nova-compute[74540]:   </features>
Nov 07 04:08:26 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:08:26 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:08:26 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:08:26 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:08:26 user nova-compute[74540]:   </clock>
Nov 07 04:08:26 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:08:26 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:08:26 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:08:26 user nova-compute[74540]:   </cpu>
Nov 07 04:08:26 user nova-compute[74540]:   <devices>
Nov 07 04:08:26 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:08:26 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:08:26 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk"/>
Nov 07 04:08:26 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:08:26 user nova-compute[74540]:     </disk>
Nov 07 04:08:26 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:08:26 user nova-compute[74540]:       <mac address="fa:16:3e:f7:9f:73"/>
Nov 07 04:08:26 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:08:26 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:08:26 user nova-compute[74540]:       <target dev="tap68a8f22b-c3"/>
Nov 07 04:08:26 user nova-compute[74540]:     </interface>
Nov 07 04:08:26 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:08:26 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/console.log" append="off"/>
Nov 07 04:08:26 user nova-compute[74540]:     </serial>
Nov 07 04:08:26 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:08:26 user nova-compute[74540]:     <video>
Nov 07 04:08:26 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:08:26 user nova-compute[74540]:     </video>
Nov 07 04:08:26 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:08:26 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:08:26 user nova-compute[74540]:     </rng>
Nov 07 04:08:26 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:08:26 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:08:26 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:08:26 user nova-compute[74540]:     </memballoon>
Nov 07 04:08:26 user nova-compute[74540]:   </devices>
Nov 07 04:08:26 user nova-compute[74540]: </domain>
Nov 07 04:08:26 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1772667439',display_name='tempest-AttachVolumeNegativeTest-server-1772667439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1772667439',id=24,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANZIRK0djzkHWUv72oPiNJN+/Z03DvhkpML1H24uDTtZ9wofEjnoeD1A/JIq2OWLCdMQuoS7KxQ2nTwhxDaAE2IwBppbST8e/3+cnZgkSJAT/BuHuxadAAsqNCaLwBFCA==',key_name='tempest-keypair-310613541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='620cefdadcec49d6a696aa7db8cef2d1',ramdisk_id='',reservation_id='r-sqydcp6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-306463361',owner_user_name='tempest-AttachVolumeNegativeTest-306463361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:08:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3079ba3a84ea4b4bb4a3e576ab4133ae',uuid=5d120b2b-8d1b-4d19-8364-ab4dad61bad3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "address": "fa:16:3e:f7:9f:73", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a8f22b-c3", "ovs_interfaceid": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converting VIF {"id": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "address": "fa:16:3e:f7:9f:73", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a8f22b-c3", "ovs_interfaceid": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=68a8f22b-c3f1-4575-b2f3-29af6c59af12,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a8f22b-c3') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG os_vif [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=68a8f22b-c3f1-4575-b2f3-29af6c59af12,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a8f22b-c3') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6718b026-59a1-5c19-b1d0-d3e3680e3e36', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68a8f22b-c3, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68a8f22b-c3, col_values=(('qos', UUID('d69fc186-fec3-45d8-9844-07cdba547dd2')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68a8f22b-c3, col_values=(('external_ids', {'iface-id': '68a8f22b-c3f1-4575-b2f3-29af6c59af12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:9f:73', 'vm-uuid': '5d120b2b-8d1b-4d19-8364-ab4dad61bad3'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfqFEcSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:08:27 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:08:27 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:08:27 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:08:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:27 user nova-compute[74540]: INFO os_vif [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=68a8f22b-c3f1-4575-b2f3-29af6c59af12,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a8f22b-c3')
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260" returned: 21 in 0.044s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[08294c0f-6818-4959-8442-60b6bab41f19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:08:27 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8789bbe2-1a97-4a97-a1ea-026e7a8e9097]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9] added
Nov 07 04:08:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No VIF found with MAC fa:16:3e:f7:9f:73, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53e7943-a127-4c7d-a255-f14f464e8248]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb1bb60-be52-4926-9b6a-a9c4b9f9b600]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PfqFEcSw {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PfqFEcSw" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[094d3033-a00a-4ac6-ace1-3128c2398b8c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PfqFEcSw'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb104fc-f0eb-4991-ab78-f81281c3c8be]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26f4954-f86c-44b4-ab7e-3543657d0e7c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:08:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:08:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG nova.network.neutron [req-1c9c2412-d884-4cdd-b3ed-29a732bf06e9 req-ea9e953f-3ad4-4a69-990c-726fd6585ec8 service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Updated VIF entry in instance network info cache for port 68a8f22b-c3f1-4575-b2f3-29af6c59af12. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG nova.network.neutron [req-1c9c2412-d884-4cdd-b3ed-29a732bf06e9 req-ea9e953f-3ad4-4a69-990c-726fd6585ec8 service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Updating instance_info_cache with network_info: [{"id": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "address": "fa:16:3e:f7:9f:73", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a8f22b-c3", "ovs_interfaceid": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[450b9737-84fd-4e0b-82e4-78f884ecd877]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9, portal: 172.16.0.220,3260]
Nov 07 04:08:27 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9, portal: 172.16.0.220,3260] successful.
Nov 07 04:08:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c9c2412-d884-4cdd-b3ed-29a732bf06e9 req-ea9e953f-3ad4-4a69-990c-726fd6585ec8 service nova] Releasing lock "refresh_cache-5d120b2b-8d1b-4d19-8364-ab4dad61bad3" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[82771d18-8b9f-4e09-9757-8295acb4ac02]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdc6c5d-29cb-40f4-ac3f-2d44743c9c7f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 (non-flash)
Nov 07 04:08:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:08:27 user nova-compute[74540]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 (non-flash)
Nov 07 04:08:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d19a7d2-58f6-4392-8613-fae316aa541b]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:08:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfqFEcSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:08:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:08:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23565373264383961', 'path': '/dev/sdf'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:08:28 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565373264383961', 'path': '/dev/sdf'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:08:28 user nova-compute[74540]: DEBUG nova.objects.instance [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lazy-loading 'flavor' on Instance uuid 332796aa-adda-40ef-8650-126641e30821 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:28 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:08:28 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:08:28 user nova-compute[74540]:   <source dev="/dev/sdf"/>
Nov 07 04:08:28 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:08:28 user nova-compute[74540]:   <serial>1330d631-36c9-4c96-9677-d41e6aaf6ce9</serial>
Nov 07 04:08:28 user nova-compute[74540]: </disk>
Nov 07 04:08:28 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:08:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-6c62c9a5-5e8e-4a5c-9a30-fcdfc887202c req-ac265ce9-01bf-437f-a6ce-fc80ed39a932 service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Received event network-vif-plugged-68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:08:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6c62c9a5-5e8e-4a5c-9a30-fcdfc887202c req-ac265ce9-01bf-437f-a6ce-fc80ed39a932 service nova] Acquiring lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6c62c9a5-5e8e-4a5c-9a30-fcdfc887202c req-ac265ce9-01bf-437f-a6ce-fc80ed39a932 service nova] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6c62c9a5-5e8e-4a5c-9a30-fcdfc887202c req-ac265ce9-01bf-437f-a6ce-fc80ed39a932 service nova] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-6c62c9a5-5e8e-4a5c-9a30-fcdfc887202c req-ac265ce9-01bf-437f-a6ce-fc80ed39a932 service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] No waiting events found dispatching network-vif-plugged-68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:08:29 user nova-compute[74540]: WARNING nova.compute.manager [req-6c62c9a5-5e8e-4a5c-9a30-fcdfc887202c req-ac265ce9-01bf-437f-a6ce-fc80ed39a932 service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Received unexpected event network-vif-plugged-68a8f22b-c3f1-4575-b2f3-29af6c59af12 for instance with vm_state building and task_state spawning.
Nov 07 04:08:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:08:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] No BDM found with device name hda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:08:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] No VIF found with MAC fa:16:3e:2e:77:3f, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:08:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-13b9b07c-d768-44c8-9be8-f45036bd100d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "332796aa-adda-40ef-8650-126641e30821" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 49.125s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:30 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-19ae381c-2844-4cae-a9fd-d3588317f6a2 req-a9e26101-8c99-4d09-b95f-28a48ba8c631 service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Received event network-vif-plugged-68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-19ae381c-2844-4cae-a9fd-d3588317f6a2 req-a9e26101-8c99-4d09-b95f-28a48ba8c631 service nova] Acquiring lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-19ae381c-2844-4cae-a9fd-d3588317f6a2 req-a9e26101-8c99-4d09-b95f-28a48ba8c631 service nova] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-19ae381c-2844-4cae-a9fd-d3588317f6a2 req-a9e26101-8c99-4d09-b95f-28a48ba8c631 service nova] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-19ae381c-2844-4cae-a9fd-d3588317f6a2 req-a9e26101-8c99-4d09-b95f-28a48ba8c631 service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] No waiting events found dispatching network-vif-plugged-68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:08:31 user nova-compute[74540]: WARNING nova.compute.manager [req-19ae381c-2844-4cae-a9fd-d3588317f6a2 req-a9e26101-8c99-4d09-b95f-28a48ba8c631 service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Received unexpected event network-vif-plugged-68a8f22b-c3f1-4575-b2f3-29af6c59af12 for instance with vm_state building and task_state spawning.
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:08:31 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Instance spawned successfully.
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "332796aa-adda-40ef-8650-126641e30821" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "332796aa-adda-40ef-8650-126641e30821" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:31 user nova-compute[74540]: INFO nova.compute.manager [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Detaching volume 1330d631-36c9-4c96-9677-d41e6aaf6ce9
Nov 07 04:08:31 user nova-compute[74540]: INFO nova.compute.manager [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Took 6.93 seconds to spawn the instance on the hypervisor.
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:08:31 user nova-compute[74540]: INFO nova.virt.block_device [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Attempting to driver detach volume 1330d631-36c9-4c96-9677-d41e6aaf6ce9 from mountpoint /dev/vdb
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Attempting to detach device vdb from instance 332796aa-adda-40ef-8650-126641e30821 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:08:31 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:08:31 user nova-compute[74540]:   <source dev="/dev/sdf"/>
Nov 07 04:08:31 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:08:31 user nova-compute[74540]:   <serial>1330d631-36c9-4c96-9677-d41e6aaf6ce9</serial>
Nov 07 04:08:31 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 07 04:08:31 user nova-compute[74540]: </disk>
Nov 07 04:08:31 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:08:31 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Successfully detached device vdb from instance 332796aa-adda-40ef-8650-126641e30821 from the persistent domain config.
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 332796aa-adda-40ef-8650-126641e30821 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:08:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:08:31 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:08:31 user nova-compute[74540]:   <source dev="/dev/sdf"/>
Nov 07 04:08:31 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:08:31 user nova-compute[74540]:   <serial>1330d631-36c9-4c96-9677-d41e6aaf6ce9</serial>
Nov 07 04:08:31 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 07 04:08:31 user nova-compute[74540]: </disk>
Nov 07 04:08:31 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:08:31 user nova-compute[74540]: INFO nova.compute.manager [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Took 8.04 seconds to build instance.
Nov 07 04:08:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4fd7b322-6d79-4476-b519-3ecf274dd4da tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.189s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 332796aa-adda-40ef-8650-126641e30821 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:08:34 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:08:34 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:08:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:37 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:08:38 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:08:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:08:39 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:08:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:08:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:08:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:08:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:08:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:08:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:45 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:08:45 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7422MB free_disk=25.103172302246094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d61ec49c-3345-4808-bfcd-a9d925fe1918 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 332796aa-adda-40ef-8650-126641e30821 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6b84cdaa-6964-4e16-95b3-accb9086d871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:08:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:08:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:08:46 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:08:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:08:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:08:46 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:08:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:47 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updating instance_info_cache with network_info: [{"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:08:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:08:47 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:08:47 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:08:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:52 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 332796aa-adda-40ef-8650-126641e30821 is timed out.
Nov 07 04:08:52 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Successfully detached device vdb from instance 332796aa-adda-40ef-8650-126641e30821 from the live domain config.
Nov 07 04:08:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PfqFEcSw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:08:52 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88b172e-3569-4f48-8f23-5d71c59fb8f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:08:52 user nova-compute[74540]: No targets found.
Nov 07 04:08:52 user nova-compute[74540]: iSNS:
Nov 07 04:08:52 user nova-compute[74540]: No targets found.
Nov 07 04:08:52 user nova-compute[74540]: STATIC:
Nov 07 04:08:52 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598
Nov 07 04:08:52 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:08:52 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:08:52 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814
Nov 07 04:08:52 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:08:52 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:08:52 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9
Nov 07 04:08:52 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:08:52 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:08:52 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a
Nov 07 04:08:52 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:08:52 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:08:52 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c
Nov 07 04:08:52 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:08:52 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:08:52 user nova-compute[74540]: FIRMWARE:
Nov 07 04:08:52 user nova-compute[74540]: No targets found.
Nov 07 04:08:52 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:08:52 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:08:52 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dfe079-161a-4004-aa6b-fe0f97ff148a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b320c704-61fc-405e-b032-48b47c1b9520]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:52 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:52 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:52 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:08:52 user nova-compute[74540]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 (non-flash)
Nov 07 04:08:52 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:08:52 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:08:52 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:08:52 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:08:52 user nova-compute[74540]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 (non-flash)
Nov 07 04:08:52 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee141ace50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9'): ({'sdf'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Removing single pathed devices sdf {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab27a7b-68da-4153-8c5a-56a84f6912fc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c1bf31-a3a4-4678-b796-28dd5b39b818]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Flushing IO for device /dev/sdf {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b145e7b-190e-4f1d-a201-82d796ecef59]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddb0f33-32d2-466a-afd7-d94beb100127]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] SCSI volumes sdf have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ff2c8b-34ac-4e5b-b911-ae93e5b0904e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8093ea87-3b2a-4368-803f-d9eb7d834545]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9, portal: 172.16.0.220,3260]
Nov 07 04:08:52 user nova-compute[74540]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9, portal: 172.16.0.220,3260] successful.
Nov 07 04:08:52 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1330d631-36c9-4c96-9677-d41e6aaf6ce9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4389e5e-ae3b-47da-8ace-c49f9f7dc5cd]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] <== disconnect_volume: return (309ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:08:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:08:53 user nova-compute[74540]: DEBUG nova.objects.instance [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lazy-loading 'flavor' on Instance uuid 332796aa-adda-40ef-8650-126641e30821 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-820a5b4e-790b-455a-ad91-d381ba39425d tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "332796aa-adda-40ef-8650-126641e30821" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.166s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "interface-332796aa-adda-40ef-8650-126641e30821-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "interface-332796aa-adda-40ef-8650-126641e30821-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG nova.objects.instance [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lazy-loading 'flavor' on Instance uuid 332796aa-adda-40ef-8650-126641e30821 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T04:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583633477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583633477',id=22,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7qsXSGLs+mC92IhCOo9fu/hTPQ5t1+AS7uJm7dv0HXMtIsNXU9ojGEHLtMbGRbnw9Yr5blprgPfBKlEZhTtmiDGlxqbo6WyQ4dq718r+8MLhSRzzyL2Hp9P9gMScDwtA==',key_name='tempest-keypair-1229377363',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac7b6c7a58f842129f0f27294085214a',ramdisk_id='',reservation_id='r-l9bskaef',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-793581715',owner_user_name='tempest-TaggedAttachmentsTest-793581715-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f469ca83fe184f1698ed812016fb5b64',uuid=332796aa-adda-40ef-8650-126641e30821,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converting VIF {"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=69c97beb-2ba9-428a-abcd-8a17f4bf3c1b,network=Network(a79bd329-e3be-44f3-975e-869368c6b5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c97beb-2b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cd:be:e0"/><model type="virtio"/><mtu size="1442"/><target dev="tap69c97beb-2b"/></interface> {{(pid=74540) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cd:be:e0"/><model type="virtio"/><mtu size="1442"/><target dev="tap69c97beb-2b"/></interface> {{(pid=74540) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Attempting to detach device tap69c97beb-2b from instance 332796aa-adda-40ef-8650-126641e30821 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] detach device xml: <interface type="ethernet">
Nov 07 04:08:54 user nova-compute[74540]:   <mac address="fa:16:3e:cd:be:e0"/>
Nov 07 04:08:54 user nova-compute[74540]:   <model type="virtio"/>
Nov 07 04:08:54 user nova-compute[74540]:   <mtu size="1442"/>
Nov 07 04:08:54 user nova-compute[74540]:   <target dev="tap69c97beb-2b"/>
Nov 07 04:08:54 user nova-compute[74540]: </interface>
Nov 07 04:08:54 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cd:be:e0"/><model type="virtio"/><mtu size="1442"/><target dev="tap69c97beb-2b"/></interface> {{(pid=74540) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cd:be:e0"/><model type="virtio"/><mtu size="1442"/><target dev="tap69c97beb-2b"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 07 04:08:54 user nova-compute[74540]:   <name>instance-00000016</name>
Nov 07 04:08:54 user nova-compute[74540]:   <uuid>332796aa-adda-40ef-8650-126641e30821</uuid>
Nov 07 04:08:54 user nova-compute[74540]:   <metadata>
Nov 07 04:08:54 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:08:54 user nova-compute[74540]:   <nova:package version="0.0.0"/>
Nov 07 04:08:54 user nova-compute[74540]:   <nova:name>tempest-device-tagging-server-1583633477</nova:name>
Nov 07 04:08:54 user nova-compute[74540]:   <nova:creationTime>2023-11-07 04:07:39</nova:creationTime>
Nov 07 04:08:54 user nova-compute[74540]:   <nova:flavor name="m1.tiny">
Nov 07 04:08:54 user nova-compute[74540]:     <nova:memory>512</nova:memory>
Nov 07 04:08:54 user nova-compute[74540]:     <nova:disk>1</nova:disk>
Nov 07 04:08:54 user nova-compute[74540]:     <nova:swap>0</nova:swap>
Nov 07 04:08:54 user nova-compute[74540]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:08:54 user nova-compute[74540]:     <nova:vcpus>1</nova:vcpus>
Nov 07 04:08:54 user nova-compute[74540]:   </nova:flavor>
Nov 07 04:08:54 user nova-compute[74540]:   <nova:owner>
Nov 07 04:08:54 user nova-compute[74540]:     <nova:user uuid="f469ca83fe184f1698ed812016fb5b64">tempest-TaggedAttachmentsTest-793581715-project-member</nova:user>
Nov 07 04:08:54 user nova-compute[74540]:     <nova:project uuid="ac7b6c7a58f842129f0f27294085214a">tempest-TaggedAttachmentsTest-793581715</nova:project>
Nov 07 04:08:54 user nova-compute[74540]:   </nova:owner>
Nov 07 04:08:54 user nova-compute[74540]:   <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:08:54 user nova-compute[74540]:   <nova:ports>
Nov 07 04:08:54 user nova-compute[74540]:     <nova:port uuid="abb88c7a-347e-428e-8069-d2419ed701c3">
Nov 07 04:08:54 user nova-compute[74540]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:08:54 user nova-compute[74540]:     </nova:port>
Nov 07 04:08:54 user nova-compute[74540]:     <nova:port uuid="69c97beb-2ba9-428a-abcd-8a17f4bf3c1b">
Nov 07 04:08:54 user nova-compute[74540]:       <nova:ip type="fixed" address="10.10.10.16" ipVersion="4"/>
Nov 07 04:08:54 user nova-compute[74540]:     </nova:port>
Nov 07 04:08:54 user nova-compute[74540]:   </nova:ports>
Nov 07 04:08:54 user nova-compute[74540]: </nova:instance>
Nov 07 04:08:54 user nova-compute[74540]:   </metadata>
Nov 07 04:08:54 user nova-compute[74540]:   <memory unit='KiB'>524288</memory>
Nov 07 04:08:54 user nova-compute[74540]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 07 04:08:54 user nova-compute[74540]:   <vcpu placement='static'>1</vcpu>
Nov 07 04:08:54 user nova-compute[74540]:   <resource>
Nov 07 04:08:54 user nova-compute[74540]:     <partition>/machine</partition>
Nov 07 04:08:54 user nova-compute[74540]:   </resource>
Nov 07 04:08:54 user nova-compute[74540]:   <sysinfo type='smbios'>
Nov 07 04:08:54 user nova-compute[74540]:     <system>
Nov 07 04:08:54 user nova-compute[74540]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 07 04:08:54 user nova-compute[74540]:       <entry name='product'>OpenStack Nova</entry>
Nov 07 04:08:54 user nova-compute[74540]:       <entry name='version'>0.0.0</entry>
Nov 07 04:08:54 user nova-compute[74540]:       <entry name='serial'>332796aa-adda-40ef-8650-126641e30821</entry>
Nov 07 04:08:54 user nova-compute[74540]:       <entry name='uuid'>332796aa-adda-40ef-8650-126641e30821</entry>
Nov 07 04:08:54 user nova-compute[74540]:       <entry name='family'>Virtual Machine</entry>
Nov 07 04:08:54 user nova-compute[74540]:     </system>
Nov 07 04:08:54 user nova-compute[74540]:   </sysinfo>
Nov 07 04:08:54 user nova-compute[74540]:   <os>
Nov 07 04:08:54 user nova-compute[74540]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 07 04:08:54 user nova-compute[74540]:     <boot dev='hd'/>
Nov 07 04:08:54 user nova-compute[74540]:     <smbios mode='sysinfo'/>
Nov 07 04:08:54 user nova-compute[74540]:   </os>
Nov 07 04:08:54 user nova-compute[74540]:   <features>
Nov 07 04:08:54 user nova-compute[74540]:     <acpi/>
Nov 07 04:08:54 user nova-compute[74540]:     <apic/>
Nov 07 04:08:54 user nova-compute[74540]:     <vmcoreinfo state='on'/>
Nov 07 04:08:54 user nova-compute[74540]:   </features>
Nov 07 04:08:54 user nova-compute[74540]:   <cpu mode='custom' match='exact' check='full'>
Nov 07 04:08:54 user nova-compute[74540]:     <model fallback='forbid'>Nehalem</model>
Nov 07 04:08:54 user nova-compute[74540]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 07 04:08:54 user nova-compute[74540]:     <feature policy='require' name='vme'/>
Nov 07 04:08:54 user nova-compute[74540]:     <feature policy='require' name='x2apic'/>
Nov 07 04:08:54 user nova-compute[74540]:     <feature policy='require' name='hypervisor'/>
Nov 07 04:08:54 user nova-compute[74540]:   </cpu>
Nov 07 04:08:54 user nova-compute[74540]:   <clock offset='utc'>
Nov 07 04:08:54 user nova-compute[74540]:     <timer name='pit' tickpolicy='delay'/>
Nov 07 04:08:54 user nova-compute[74540]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 07 04:08:54 user nova-compute[74540]:     <timer name='hpet' present='no'/>
Nov 07 04:08:54 user nova-compute[74540]:   </clock>
Nov 07 04:08:54 user nova-compute[74540]:   <on_poweroff>destroy</on_poweroff>
Nov 07 04:08:54 user nova-compute[74540]:   <on_reboot>restart</on_reboot>
Nov 07 04:08:54 user nova-compute[74540]:   <on_crash>destroy</on_crash>
Nov 07 04:08:54 user nova-compute[74540]:   <devices>
Nov 07 04:08:54 user nova-compute[74540]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 07 04:08:54 user nova-compute[74540]:     <disk type='file' device='disk'>
Nov 07 04:08:54 user nova-compute[74540]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 07 04:08:54 user nova-compute[74540]:       <source file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk' index='2'/>
Nov 07 04:08:54 user nova-compute[74540]:       <backingStore type='file' index='3'>
Nov 07 04:08:54 user nova-compute[74540]:         <format type='raw'/>
Nov 07 04:08:54 user nova-compute[74540]:         <source file='/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c'/>
Nov 07 04:08:54 user nova-compute[74540]:         <backingStore/>
Nov 07 04:08:54 user nova-compute[74540]:       </backingStore>
Nov 07 04:08:54 user nova-compute[74540]:       <target dev='vda' bus='virtio'/>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='virtio-disk0'/>
Nov 07 04:08:54 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 07 04:08:54 user nova-compute[74540]:     </disk>
Nov 07 04:08:54 user nova-compute[74540]:     <disk type='file' device='cdrom'>
Nov 07 04:08:54 user nova-compute[74540]:       <driver name='qemu' type='raw' cache='none'/>
Nov 07 04:08:54 user nova-compute[74540]:       <source file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk.config' index='1'/>
Nov 07 04:08:54 user nova-compute[74540]:       <backingStore/>
Nov 07 04:08:54 user nova-compute[74540]:       <target dev='hda' bus='ide'/>
Nov 07 04:08:54 user nova-compute[74540]:       <readonly/>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='ide0-0-0'/>
Nov 07 04:08:54 user nova-compute[74540]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 07 04:08:54 user nova-compute[74540]:     </disk>
Nov 07 04:08:54 user nova-compute[74540]:     <controller type='usb' index='0' model='none'>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='usb'/>
Nov 07 04:08:54 user nova-compute[74540]:     </controller>
Nov 07 04:08:54 user nova-compute[74540]:     <controller type='pci' index='0' model='pci-root'>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='pci.0'/>
Nov 07 04:08:54 user nova-compute[74540]:     </controller>
Nov 07 04:08:54 user nova-compute[74540]:     <controller type='ide' index='0'>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='ide'/>
Nov 07 04:08:54 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 07 04:08:54 user nova-compute[74540]:     </controller>
Nov 07 04:08:54 user nova-compute[74540]:     <interface type='ethernet'>
Nov 07 04:08:54 user nova-compute[74540]:       <mac address='fa:16:3e:2e:77:3f'/>
Nov 07 04:08:54 user nova-compute[74540]:       <target dev='tapabb88c7a-34'/>
Nov 07 04:08:54 user nova-compute[74540]:       <model type='virtio'/>
Nov 07 04:08:54 user nova-compute[74540]:       <mtu size='1442'/>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='net0'/>
Nov 07 04:08:54 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 07 04:08:54 user nova-compute[74540]:     </interface>
Nov 07 04:08:54 user nova-compute[74540]:     <interface type='ethernet'>
Nov 07 04:08:54 user nova-compute[74540]:       <mac address='fa:16:3e:cd:be:e0'/>
Nov 07 04:08:54 user nova-compute[74540]:       <target dev='tap69c97beb-2b'/>
Nov 07 04:08:54 user nova-compute[74540]:       <model type='virtio'/>
Nov 07 04:08:54 user nova-compute[74540]:       <mtu size='1442'/>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='net1'/>
Nov 07 04:08:54 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 07 04:08:54 user nova-compute[74540]:     </interface>
Nov 07 04:08:54 user nova-compute[74540]:     <serial type='pty'>
Nov 07 04:08:54 user nova-compute[74540]:       <source path='/dev/pts/4'/>
Nov 07 04:08:54 user nova-compute[74540]:       <log file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/console.log' append='off'/>
Nov 07 04:08:54 user nova-compute[74540]:       <target type='isa-serial' port='0'>
Nov 07 04:08:54 user nova-compute[74540]:         <model name='isa-serial'/>
Nov 07 04:08:54 user nova-compute[74540]:       </target>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='serial0'/>
Nov 07 04:08:54 user nova-compute[74540]:     </serial>
Nov 07 04:08:54 user nova-compute[74540]:     <console type='pty' tty='/dev/pts/4'>
Nov 07 04:08:54 user nova-compute[74540]:       <source path='/dev/pts/4'/>
Nov 07 04:08:54 user nova-compute[74540]:       <log file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/console.log' append='off'/>
Nov 07 04:08:54 user nova-compute[74540]:       <target type='serial' port='0'/>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='serial0'/>
Nov 07 04:08:54 user nova-compute[74540]:     </console>
Nov 07 04:08:54 user nova-compute[74540]:     <input type='mouse' bus='ps2'>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='input0'/>
Nov 07 04:08:54 user nova-compute[74540]:     </input>
Nov 07 04:08:54 user nova-compute[74540]:     <input type='keyboard' bus='ps2'>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='input1'/>
Nov 07 04:08:54 user nova-compute[74540]:     </input>
Nov 07 04:08:54 user nova-compute[74540]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Nov 07 04:08:54 user nova-compute[74540]:       <listen type='address' address='0.0.0.0'/>
Nov 07 04:08:54 user nova-compute[74540]:     </graphics>
Nov 07 04:08:54 user nova-compute[74540]:     <audio id='1' type='none'/>
Nov 07 04:08:54 user nova-compute[74540]:     <video>
Nov 07 04:08:54 user nova-compute[74540]:       <model type='virtio' heads='1' primary='yes'/>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='video0'/>
Nov 07 04:08:54 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 07 04:08:54 user nova-compute[74540]:     </video>
Nov 07 04:08:54 user nova-compute[74540]:     <memballoon model='virtio'>
Nov 07 04:08:54 user nova-compute[74540]:       <stats period='10'/>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='balloon0'/>
Nov 07 04:08:54 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 07 04:08:54 user nova-compute[74540]:     </memballoon>
Nov 07 04:08:54 user nova-compute[74540]:     <rng model='virtio'>
Nov 07 04:08:54 user nova-compute[74540]:       <backend model='random'>/dev/urandom</backend>
Nov 07 04:08:54 user nova-compute[74540]:       <alias name='rng0'/>
Nov 07 04:08:54 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 07 04:08:54 user nova-compute[74540]:     </rng>
Nov 07 04:08:54 user nova-compute[74540]:   </devices>
Nov 07 04:08:54 user nova-compute[74540]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 07 04:08:54 user nova-compute[74540]:     <label>libvirt-332796aa-adda-40ef-8650-126641e30821</label>
Nov 07 04:08:54 user nova-compute[74540]:     <imagelabel>libvirt-332796aa-adda-40ef-8650-126641e30821</imagelabel>
Nov 07 04:08:54 user nova-compute[74540]:   </seclabel>
Nov 07 04:08:54 user nova-compute[74540]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 07 04:08:54 user nova-compute[74540]:     <label>+64055:+108</label>
Nov 07 04:08:54 user nova-compute[74540]:     <imagelabel>+64055:+108</imagelabel>
Nov 07 04:08:54 user nova-compute[74540]:   </seclabel>
Nov 07 04:08:54 user nova-compute[74540]: </domain>
Nov 07 04:08:54 user nova-compute[74540]:  {{(pid=74540) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 07 04:08:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Successfully detached device tap69c97beb-2b from instance 332796aa-adda-40ef-8650-126641e30821 from the persistent domain config.
Nov 07 04:08:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] (1/8): Attempting to detach device tap69c97beb-2b with device alias net1 from instance 332796aa-adda-40ef-8650-126641e30821 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:08:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] detach device xml: <interface type="ethernet">
Nov 07 04:08:54 user nova-compute[74540]:   <mac address="fa:16:3e:cd:be:e0"/>
Nov 07 04:08:54 user nova-compute[74540]:   <model type="virtio"/>
Nov 07 04:08:54 user nova-compute[74540]:   <mtu size="1442"/>
Nov 07 04:08:54 user nova-compute[74540]:   <target dev="tap69c97beb-2b"/>
Nov 07 04:08:54 user nova-compute[74540]: </interface>
Nov 07 04:08:54 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:08:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Start waiting for the detach event from libvirt for device tap69c97beb-2b with device alias net1 for instance 332796aa-adda-40ef-8650-126641e30821 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:08:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-8181183b-7a41-4284-a705-9592a862bcbc req-7af74d98-370b-44fd-ade7-b628188c53af service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-vif-unplugged-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:08:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8181183b-7a41-4284-a705-9592a862bcbc req-7af74d98-370b-44fd-ade7-b628188c53af service nova] Acquiring lock "332796aa-adda-40ef-8650-126641e30821-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8181183b-7a41-4284-a705-9592a862bcbc req-7af74d98-370b-44fd-ade7-b628188c53af service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8181183b-7a41-4284-a705-9592a862bcbc req-7af74d98-370b-44fd-ade7-b628188c53af service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-8181183b-7a41-4284-a705-9592a862bcbc req-7af74d98-370b-44fd-ade7-b628188c53af service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] No waiting events found dispatching network-vif-unplugged-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:08:55 user nova-compute[74540]: WARNING nova.compute.manager [req-8181183b-7a41-4284-a705-9592a862bcbc req-7af74d98-370b-44fd-ade7-b628188c53af service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received unexpected event network-vif-unplugged-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b for instance with vm_state active and task_state None.
Nov 07 04:08:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:08:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-ac8e783e-3fdb-4254-8c27-8de94a5b901b req-f758aa42-0187-4aa6-a305-ac4ef5b8d42e service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-vif-plugged-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:08:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ac8e783e-3fdb-4254-8c27-8de94a5b901b req-f758aa42-0187-4aa6-a305-ac4ef5b8d42e service nova] Acquiring lock "332796aa-adda-40ef-8650-126641e30821-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:08:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ac8e783e-3fdb-4254-8c27-8de94a5b901b req-f758aa42-0187-4aa6-a305-ac4ef5b8d42e service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:08:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ac8e783e-3fdb-4254-8c27-8de94a5b901b req-f758aa42-0187-4aa6-a305-ac4ef5b8d42e service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:08:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-ac8e783e-3fdb-4254-8c27-8de94a5b901b req-f758aa42-0187-4aa6-a305-ac4ef5b8d42e service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] No waiting events found dispatching network-vif-plugged-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:08:57 user nova-compute[74540]: WARNING nova.compute.manager [req-ac8e783e-3fdb-4254-8c27-8de94a5b901b req-f758aa42-0187-4aa6-a305-ac4ef5b8d42e service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received unexpected event network-vif-plugged-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b for instance with vm_state active and task_state None.
Nov 07 04:08:57 user nova-compute[74540]: DEBUG nova.compute.manager [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:08:57 user nova-compute[74540]: INFO nova.compute.manager [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] instance snapshotting
Nov 07 04:08:57 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Beginning live snapshot process
Nov 07 04:08:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json -f qcow2 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json -f qcow2 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa5ky_0km/cb51647a3c704f92a442eb0974777533.delta 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:08:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpa5ky_0km/cb51647a3c704f92a442eb0974777533.delta 1073741824" returned: 0 in 0.063s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:08:58 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 07 04:08:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:08:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:08:59 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 07 04:08:59 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:08:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa5ky_0km/cb51647a3c704f92a442eb0974777533.delta /opt/stack/data/nova/instances/snapshots/tmpa5ky_0km/cb51647a3c704f92a442eb0974777533 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpa5ky_0km/cb51647a3c704f92a442eb0974777533.delta /opt/stack/data/nova/instances/snapshots/tmpa5ky_0km/cb51647a3c704f92a442eb0974777533" returned: 0 in 0.412s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:00 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Snapshot extracted, beginning image upload
Nov 07 04:09:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:03 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Snapshot image upload complete
Nov 07 04:09:03 user nova-compute[74540]: INFO nova.compute.manager [None req-81e707e1-03b0-433d-b510-8d565fbf3e85 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Took 6.19 seconds to snapshot the instance on the hypervisor.
Nov 07 04:09:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:09:15 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Waiting for libvirt event about the detach of device tap69c97beb-2b with device alias net1 from instance 332796aa-adda-40ef-8650-126641e30821 is timed out.
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cd:be:e0"/><model type="virtio"/><mtu size="1442"/><target dev="tap69c97beb-2b"/></interface> {{(pid=74540) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cd:be:e0"/><model type="virtio"/><mtu size="1442"/><target dev="tap69c97beb-2b"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 07 04:09:15 user nova-compute[74540]:   <name>instance-00000016</name>
Nov 07 04:09:15 user nova-compute[74540]:   <uuid>332796aa-adda-40ef-8650-126641e30821</uuid>
Nov 07 04:09:15 user nova-compute[74540]:   <metadata>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:09:15 user nova-compute[74540]:   <nova:package version="0.0.0"/>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:name>tempest-device-tagging-server-1583633477</nova:name>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:creationTime>2023-11-07 04:07:39</nova:creationTime>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:flavor name="m1.tiny">
Nov 07 04:09:15 user nova-compute[74540]:     <nova:memory>512</nova:memory>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:disk>1</nova:disk>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:swap>0</nova:swap>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:vcpus>1</nova:vcpus>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:flavor>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:owner>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:user uuid="f469ca83fe184f1698ed812016fb5b64">tempest-TaggedAttachmentsTest-793581715-project-member</nova:user>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:project uuid="ac7b6c7a58f842129f0f27294085214a">tempest-TaggedAttachmentsTest-793581715</nova:project>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:owner>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:ports>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:port uuid="abb88c7a-347e-428e-8069-d2419ed701c3">
Nov 07 04:09:15 user nova-compute[74540]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:09:15 user nova-compute[74540]:     </nova:port>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:port uuid="69c97beb-2ba9-428a-abcd-8a17f4bf3c1b">
Nov 07 04:09:15 user nova-compute[74540]:       <nova:ip type="fixed" address="10.10.10.16" ipVersion="4"/>
Nov 07 04:09:15 user nova-compute[74540]:     </nova:port>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:ports>
Nov 07 04:09:15 user nova-compute[74540]: </nova:instance>
Nov 07 04:09:15 user nova-compute[74540]:   </metadata>
Nov 07 04:09:15 user nova-compute[74540]:   <memory unit='KiB'>524288</memory>
Nov 07 04:09:15 user nova-compute[74540]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 07 04:09:15 user nova-compute[74540]:   <vcpu placement='static'>1</vcpu>
Nov 07 04:09:15 user nova-compute[74540]:   <resource>
Nov 07 04:09:15 user nova-compute[74540]:     <partition>/machine</partition>
Nov 07 04:09:15 user nova-compute[74540]:   </resource>
Nov 07 04:09:15 user nova-compute[74540]:   <sysinfo type='smbios'>
Nov 07 04:09:15 user nova-compute[74540]:     <system>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='product'>OpenStack Nova</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='version'>0.0.0</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='serial'>332796aa-adda-40ef-8650-126641e30821</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='uuid'>332796aa-adda-40ef-8650-126641e30821</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='family'>Virtual Machine</entry>
Nov 07 04:09:15 user nova-compute[74540]:     </system>
Nov 07 04:09:15 user nova-compute[74540]:   </sysinfo>
Nov 07 04:09:15 user nova-compute[74540]:   <os>
Nov 07 04:09:15 user nova-compute[74540]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 07 04:09:15 user nova-compute[74540]:     <boot dev='hd'/>
Nov 07 04:09:15 user nova-compute[74540]:     <smbios mode='sysinfo'/>
Nov 07 04:09:15 user nova-compute[74540]:   </os>
Nov 07 04:09:15 user nova-compute[74540]:   <features>
Nov 07 04:09:15 user nova-compute[74540]:     <acpi/>
Nov 07 04:09:15 user nova-compute[74540]:     <apic/>
Nov 07 04:09:15 user nova-compute[74540]:     <vmcoreinfo state='on'/>
Nov 07 04:09:15 user nova-compute[74540]:   </features>
Nov 07 04:09:15 user nova-compute[74540]:   <cpu mode='custom' match='exact' check='full'>
Nov 07 04:09:15 user nova-compute[74540]:     <model fallback='forbid'>Nehalem</model>
Nov 07 04:09:15 user nova-compute[74540]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 07 04:09:15 user nova-compute[74540]:     <feature policy='require' name='vme'/>
Nov 07 04:09:15 user nova-compute[74540]:     <feature policy='require' name='x2apic'/>
Nov 07 04:09:15 user nova-compute[74540]:     <feature policy='require' name='hypervisor'/>
Nov 07 04:09:15 user nova-compute[74540]:   </cpu>
Nov 07 04:09:15 user nova-compute[74540]:   <clock offset='utc'>
Nov 07 04:09:15 user nova-compute[74540]:     <timer name='pit' tickpolicy='delay'/>
Nov 07 04:09:15 user nova-compute[74540]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 07 04:09:15 user nova-compute[74540]:     <timer name='hpet' present='no'/>
Nov 07 04:09:15 user nova-compute[74540]:   </clock>
Nov 07 04:09:15 user nova-compute[74540]:   <on_poweroff>destroy</on_poweroff>
Nov 07 04:09:15 user nova-compute[74540]:   <on_reboot>restart</on_reboot>
Nov 07 04:09:15 user nova-compute[74540]:   <on_crash>destroy</on_crash>
Nov 07 04:09:15 user nova-compute[74540]:   <devices>
Nov 07 04:09:15 user nova-compute[74540]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 07 04:09:15 user nova-compute[74540]:     <disk type='file' device='disk'>
Nov 07 04:09:15 user nova-compute[74540]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 07 04:09:15 user nova-compute[74540]:       <source file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk' index='2'/>
Nov 07 04:09:15 user nova-compute[74540]:       <backingStore type='file' index='3'>
Nov 07 04:09:15 user nova-compute[74540]:         <format type='raw'/>
Nov 07 04:09:15 user nova-compute[74540]:         <source file='/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c'/>
Nov 07 04:09:15 user nova-compute[74540]:         <backingStore/>
Nov 07 04:09:15 user nova-compute[74540]:       </backingStore>
Nov 07 04:09:15 user nova-compute[74540]:       <target dev='vda' bus='virtio'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='virtio-disk0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </disk>
Nov 07 04:09:15 user nova-compute[74540]:     <disk type='file' device='cdrom'>
Nov 07 04:09:15 user nova-compute[74540]:       <driver name='qemu' type='raw' cache='none'/>
Nov 07 04:09:15 user nova-compute[74540]:       <source file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk.config' index='1'/>
Nov 07 04:09:15 user nova-compute[74540]:       <backingStore/>
Nov 07 04:09:15 user nova-compute[74540]:       <target dev='hda' bus='ide'/>
Nov 07 04:09:15 user nova-compute[74540]:       <readonly/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='ide0-0-0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </disk>
Nov 07 04:09:15 user nova-compute[74540]:     <controller type='usb' index='0' model='none'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='usb'/>
Nov 07 04:09:15 user nova-compute[74540]:     </controller>
Nov 07 04:09:15 user nova-compute[74540]:     <controller type='pci' index='0' model='pci-root'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='pci.0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </controller>
Nov 07 04:09:15 user nova-compute[74540]:     <controller type='ide' index='0'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='ide'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 07 04:09:15 user nova-compute[74540]:     </controller>
Nov 07 04:09:15 user nova-compute[74540]:     <interface type='ethernet'>
Nov 07 04:09:15 user nova-compute[74540]:       <mac address='fa:16:3e:2e:77:3f'/>
Nov 07 04:09:15 user nova-compute[74540]:       <target dev='tapabb88c7a-34'/>
Nov 07 04:09:15 user nova-compute[74540]:       <model type='virtio'/>
Nov 07 04:09:15 user nova-compute[74540]:       <mtu size='1442'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='net0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </interface>
Nov 07 04:09:15 user nova-compute[74540]:     <serial type='pty'>
Nov 07 04:09:15 user nova-compute[74540]:       <source path='/dev/pts/4'/>
Nov 07 04:09:15 user nova-compute[74540]:       <log file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/console.log' append='off'/>
Nov 07 04:09:15 user nova-compute[74540]:       <target type='isa-serial' port='0'>
Nov 07 04:09:15 user nova-compute[74540]:         <model name='isa-serial'/>
Nov 07 04:09:15 user nova-compute[74540]:       </target>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='serial0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </serial>
Nov 07 04:09:15 user nova-compute[74540]:     <console type='pty' tty='/dev/pts/4'>
Nov 07 04:09:15 user nova-compute[74540]:       <source path='/dev/pts/4'/>
Nov 07 04:09:15 user nova-compute[74540]:       <log file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/console.log' append='off'/>
Nov 07 04:09:15 user nova-compute[74540]:       <target type='serial' port='0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='serial0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </console>
Nov 07 04:09:15 user nova-compute[74540]:     <input type='mouse' bus='ps2'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='input0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </input>
Nov 07 04:09:15 user nova-compute[74540]:     <input type='keyboard' bus='ps2'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='input1'/>
Nov 07 04:09:15 user nova-compute[74540]:     </input>
Nov 07 04:09:15 user nova-compute[74540]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Nov 07 04:09:15 user nova-compute[74540]:       <listen type='address' address='0.0.0.0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </graphics>
Nov 07 04:09:15 user nova-compute[74540]:     <audio id='1' type='none'/>
Nov 07 04:09:15 user nova-compute[74540]:     <video>
Nov 07 04:09:15 user nova-compute[74540]:       <model type='virtio' heads='1' primary='yes'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='video0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </video>
Nov 07 04:09:15 user nova-compute[74540]:     <memballoon model='virtio'>
Nov 07 04:09:15 user nova-compute[74540]:       <stats period='10'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='balloon0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </memballoon>
Nov 07 04:09:15 user nova-compute[74540]:     <rng model='virtio'>
Nov 07 04:09:15 user nova-compute[74540]:       <backend model='random'>/dev/urandom</backend>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='rng0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </rng>
Nov 07 04:09:15 user nova-compute[74540]:   </devices>
Nov 07 04:09:15 user nova-compute[74540]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 07 04:09:15 user nova-compute[74540]:     <label>libvirt-332796aa-adda-40ef-8650-126641e30821</label>
Nov 07 04:09:15 user nova-compute[74540]:     <imagelabel>libvirt-332796aa-adda-40ef-8650-126641e30821</imagelabel>
Nov 07 04:09:15 user nova-compute[74540]:   </seclabel>
Nov 07 04:09:15 user nova-compute[74540]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 07 04:09:15 user nova-compute[74540]:     <label>+64055:+108</label>
Nov 07 04:09:15 user nova-compute[74540]:     <imagelabel>+64055:+108</imagelabel>
Nov 07 04:09:15 user nova-compute[74540]:   </seclabel>
Nov 07 04:09:15 user nova-compute[74540]: </domain>
Nov 07 04:09:15 user nova-compute[74540]:  {{(pid=74540) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 07 04:09:15 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Successfully detached device tap69c97beb-2b from instance 332796aa-adda-40ef-8650-126641e30821 from the live domain config.
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T04:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583633477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583633477',id=22,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7qsXSGLs+mC92IhCOo9fu/hTPQ5t1+AS7uJm7dv0HXMtIsNXU9ojGEHLtMbGRbnw9Yr5blprgPfBKlEZhTtmiDGlxqbo6WyQ4dq718r+8MLhSRzzyL2Hp9P9gMScDwtA==',key_name='tempest-keypair-1229377363',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac7b6c7a58f842129f0f27294085214a',ramdisk_id='',reservation_id='r-l9bskaef',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-793581715',owner_user_name='tempest-TaggedAttachmentsTest-793581715-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f469ca83fe184f1698ed812016fb5b64',uuid=332796aa-adda-40ef-8650-126641e30821,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converting VIF {"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=69c97beb-2ba9-428a-abcd-8a17f4bf3c1b,network=Network(a79bd329-e3be-44f3-975e-869368c6b5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c97beb-2b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG os_vif [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=69c97beb-2ba9-428a-abcd-8a17f4bf3c1b,network=Network(a79bd329-e3be-44f3-975e-869368c6b5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c97beb-2b') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69c97beb-2b, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f025fcdd-7d85-4790-bd74-5ddb0d96ac01) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:15 user nova-compute[74540]: INFO os_vif [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=69c97beb-2ba9-428a-abcd-8a17f4bf3c1b,network=Network(a79bd329-e3be-44f3-975e-869368c6b5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c97beb-2b')
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:09:15 user nova-compute[74540]:   <nova:package version="0.0.0"/>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:name>tempest-device-tagging-server-1583633477</nova:name>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:creationTime>2023-11-07 04:09:15</nova:creationTime>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:flavor name="m1.tiny">
Nov 07 04:09:15 user nova-compute[74540]:     <nova:memory>512</nova:memory>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:disk>1</nova:disk>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:swap>0</nova:swap>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:vcpus>1</nova:vcpus>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:flavor>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:owner>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:user uuid="f469ca83fe184f1698ed812016fb5b64">tempest-TaggedAttachmentsTest-793581715-project-member</nova:user>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:project uuid="ac7b6c7a58f842129f0f27294085214a">tempest-TaggedAttachmentsTest-793581715</nova:project>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:owner>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:ports>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:port uuid="abb88c7a-347e-428e-8069-d2419ed701c3">
Nov 07 04:09:15 user nova-compute[74540]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:09:15 user nova-compute[74540]:     </nova:port>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:ports>
Nov 07 04:09:15 user nova-compute[74540]: </nova:instance>
Nov 07 04:09:15 user nova-compute[74540]:  {{(pid=74540) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-vif-deleted-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:09:15 user nova-compute[74540]: INFO nova.compute.manager [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Neutron deleted interface 69c97beb-2ba9-428a-abcd-8a17f4bf3c1b; detaching it from the instance and deleting it from the info cache
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.network.neutron [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Updating instance_info_cache with network_info: [{"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquired lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.network.neutron [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.objects.instance [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] Lazy-loading 'system_metadata' on Instance uuid 332796aa-adda-40ef-8650-126641e30821 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.objects.instance [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] Lazy-loading 'flavor' on Instance uuid 332796aa-adda-40ef-8650-126641e30821 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.objects.base [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] Object Instance<332796aa-adda-40ef-8650-126641e30821> lazy-loaded attributes: system_metadata,flavor {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T04:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583633477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583633477',id=22,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7qsXSGLs+mC92IhCOo9fu/hTPQ5t1+AS7uJm7dv0HXMtIsNXU9ojGEHLtMbGRbnw9Yr5blprgPfBKlEZhTtmiDGlxqbo6WyQ4dq718r+8MLhSRzzyL2Hp9P9gMScDwtA==',key_name='tempest-keypair-1229377363',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac7b6c7a58f842129f0f27294085214a',ramdisk_id='',reservation_id='r-l9bskaef',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-793581715',owner_user_name='tempest-TaggedAttachmentsTest-793581715-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f469ca83fe184f1698ed812016fb5b64',uuid=332796aa-adda-40ef-8650-126641e30821,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] Converting VIF {"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=69c97beb-2ba9-428a-abcd-8a17f4bf3c1b,network=Network(a79bd329-e3be-44f3-975e-869368c6b5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c97beb-2b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cd:be:e0"/><model type="virtio"/><mtu size="1442"/><target dev="tap69c97beb-2b"/></interface> {{(pid=74540) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cd:be:e0"/><model type="virtio"/><mtu size="1442"/><target dev="tap69c97beb-2b"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 07 04:09:15 user nova-compute[74540]:   <name>instance-00000016</name>
Nov 07 04:09:15 user nova-compute[74540]:   <uuid>332796aa-adda-40ef-8650-126641e30821</uuid>
Nov 07 04:09:15 user nova-compute[74540]:   <metadata>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:09:15 user nova-compute[74540]:   <nova:package version="0.0.0"/>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:name>tempest-device-tagging-server-1583633477</nova:name>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:creationTime>2023-11-07 04:09:15</nova:creationTime>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:flavor name="m1.tiny">
Nov 07 04:09:15 user nova-compute[74540]:     <nova:memory>512</nova:memory>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:disk>1</nova:disk>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:swap>0</nova:swap>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:vcpus>1</nova:vcpus>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:flavor>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:owner>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:user uuid="f469ca83fe184f1698ed812016fb5b64">tempest-TaggedAttachmentsTest-793581715-project-member</nova:user>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:project uuid="ac7b6c7a58f842129f0f27294085214a">tempest-TaggedAttachmentsTest-793581715</nova:project>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:owner>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:ports>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:port uuid="abb88c7a-347e-428e-8069-d2419ed701c3">
Nov 07 04:09:15 user nova-compute[74540]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:09:15 user nova-compute[74540]:     </nova:port>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:ports>
Nov 07 04:09:15 user nova-compute[74540]: </nova:instance>
Nov 07 04:09:15 user nova-compute[74540]:   </metadata>
Nov 07 04:09:15 user nova-compute[74540]:   <memory unit='KiB'>524288</memory>
Nov 07 04:09:15 user nova-compute[74540]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 07 04:09:15 user nova-compute[74540]:   <vcpu placement='static'>1</vcpu>
Nov 07 04:09:15 user nova-compute[74540]:   <resource>
Nov 07 04:09:15 user nova-compute[74540]:     <partition>/machine</partition>
Nov 07 04:09:15 user nova-compute[74540]:   </resource>
Nov 07 04:09:15 user nova-compute[74540]:   <sysinfo type='smbios'>
Nov 07 04:09:15 user nova-compute[74540]:     <system>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='product'>OpenStack Nova</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='version'>0.0.0</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='serial'>332796aa-adda-40ef-8650-126641e30821</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='uuid'>332796aa-adda-40ef-8650-126641e30821</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='family'>Virtual Machine</entry>
Nov 07 04:09:15 user nova-compute[74540]:     </system>
Nov 07 04:09:15 user nova-compute[74540]:   </sysinfo>
Nov 07 04:09:15 user nova-compute[74540]:   <os>
Nov 07 04:09:15 user nova-compute[74540]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 07 04:09:15 user nova-compute[74540]:     <boot dev='hd'/>
Nov 07 04:09:15 user nova-compute[74540]:     <smbios mode='sysinfo'/>
Nov 07 04:09:15 user nova-compute[74540]:   </os>
Nov 07 04:09:15 user nova-compute[74540]:   <features>
Nov 07 04:09:15 user nova-compute[74540]:     <acpi/>
Nov 07 04:09:15 user nova-compute[74540]:     <apic/>
Nov 07 04:09:15 user nova-compute[74540]:     <vmcoreinfo state='on'/>
Nov 07 04:09:15 user nova-compute[74540]:   </features>
Nov 07 04:09:15 user nova-compute[74540]:   <cpu mode='custom' match='exact' check='full'>
Nov 07 04:09:15 user nova-compute[74540]:     <model fallback='forbid'>Nehalem</model>
Nov 07 04:09:15 user nova-compute[74540]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 07 04:09:15 user nova-compute[74540]:     <feature policy='require' name='vme'/>
Nov 07 04:09:15 user nova-compute[74540]:     <feature policy='require' name='x2apic'/>
Nov 07 04:09:15 user nova-compute[74540]:     <feature policy='require' name='hypervisor'/>
Nov 07 04:09:15 user nova-compute[74540]:   </cpu>
Nov 07 04:09:15 user nova-compute[74540]:   <clock offset='utc'>
Nov 07 04:09:15 user nova-compute[74540]:     <timer name='pit' tickpolicy='delay'/>
Nov 07 04:09:15 user nova-compute[74540]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 07 04:09:15 user nova-compute[74540]:     <timer name='hpet' present='no'/>
Nov 07 04:09:15 user nova-compute[74540]:   </clock>
Nov 07 04:09:15 user nova-compute[74540]:   <on_poweroff>destroy</on_poweroff>
Nov 07 04:09:15 user nova-compute[74540]:   <on_reboot>restart</on_reboot>
Nov 07 04:09:15 user nova-compute[74540]:   <on_crash>destroy</on_crash>
Nov 07 04:09:15 user nova-compute[74540]:   <devices>
Nov 07 04:09:15 user nova-compute[74540]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 07 04:09:15 user nova-compute[74540]:     <disk type='file' device='disk'>
Nov 07 04:09:15 user nova-compute[74540]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 07 04:09:15 user nova-compute[74540]:       <source file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk' index='2'/>
Nov 07 04:09:15 user nova-compute[74540]:       <backingStore type='file' index='3'>
Nov 07 04:09:15 user nova-compute[74540]:         <format type='raw'/>
Nov 07 04:09:15 user nova-compute[74540]:         <source file='/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c'/>
Nov 07 04:09:15 user nova-compute[74540]:         <backingStore/>
Nov 07 04:09:15 user nova-compute[74540]:       </backingStore>
Nov 07 04:09:15 user nova-compute[74540]:       <target dev='vda' bus='virtio'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='virtio-disk0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </disk>
Nov 07 04:09:15 user nova-compute[74540]:     <disk type='file' device='cdrom'>
Nov 07 04:09:15 user nova-compute[74540]:       <driver name='qemu' type='raw' cache='none'/>
Nov 07 04:09:15 user nova-compute[74540]:       <source file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk.config' index='1'/>
Nov 07 04:09:15 user nova-compute[74540]:       <backingStore/>
Nov 07 04:09:15 user nova-compute[74540]:       <target dev='hda' bus='ide'/>
Nov 07 04:09:15 user nova-compute[74540]:       <readonly/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='ide0-0-0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </disk>
Nov 07 04:09:15 user nova-compute[74540]:     <controller type='usb' index='0' model='none'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='usb'/>
Nov 07 04:09:15 user nova-compute[74540]:     </controller>
Nov 07 04:09:15 user nova-compute[74540]:     <controller type='pci' index='0' model='pci-root'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='pci.0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </controller>
Nov 07 04:09:15 user nova-compute[74540]:     <controller type='ide' index='0'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='ide'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 07 04:09:15 user nova-compute[74540]:     </controller>
Nov 07 04:09:15 user nova-compute[74540]:     <interface type='ethernet'>
Nov 07 04:09:15 user nova-compute[74540]:       <mac address='fa:16:3e:2e:77:3f'/>
Nov 07 04:09:15 user nova-compute[74540]:       <target dev='tapabb88c7a-34'/>
Nov 07 04:09:15 user nova-compute[74540]:       <model type='virtio'/>
Nov 07 04:09:15 user nova-compute[74540]:       <mtu size='1442'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='net0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </interface>
Nov 07 04:09:15 user nova-compute[74540]:     <serial type='pty'>
Nov 07 04:09:15 user nova-compute[74540]:       <source path='/dev/pts/4'/>
Nov 07 04:09:15 user nova-compute[74540]:       <log file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/console.log' append='off'/>
Nov 07 04:09:15 user nova-compute[74540]:       <target type='isa-serial' port='0'>
Nov 07 04:09:15 user nova-compute[74540]:         <model name='isa-serial'/>
Nov 07 04:09:15 user nova-compute[74540]:       </target>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='serial0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </serial>
Nov 07 04:09:15 user nova-compute[74540]:     <console type='pty' tty='/dev/pts/4'>
Nov 07 04:09:15 user nova-compute[74540]:       <source path='/dev/pts/4'/>
Nov 07 04:09:15 user nova-compute[74540]:       <log file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/console.log' append='off'/>
Nov 07 04:09:15 user nova-compute[74540]:       <target type='serial' port='0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='serial0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </console>
Nov 07 04:09:15 user nova-compute[74540]:     <input type='mouse' bus='ps2'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='input0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </input>
Nov 07 04:09:15 user nova-compute[74540]:     <input type='keyboard' bus='ps2'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='input1'/>
Nov 07 04:09:15 user nova-compute[74540]:     </input>
Nov 07 04:09:15 user nova-compute[74540]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Nov 07 04:09:15 user nova-compute[74540]:       <listen type='address' address='0.0.0.0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </graphics>
Nov 07 04:09:15 user nova-compute[74540]:     <audio id='1' type='none'/>
Nov 07 04:09:15 user nova-compute[74540]:     <video>
Nov 07 04:09:15 user nova-compute[74540]:       <model type='virtio' heads='1' primary='yes'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='video0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </video>
Nov 07 04:09:15 user nova-compute[74540]:     <memballoon model='virtio'>
Nov 07 04:09:15 user nova-compute[74540]:       <stats period='10'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='balloon0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </memballoon>
Nov 07 04:09:15 user nova-compute[74540]:     <rng model='virtio'>
Nov 07 04:09:15 user nova-compute[74540]:       <backend model='random'>/dev/urandom</backend>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='rng0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </rng>
Nov 07 04:09:15 user nova-compute[74540]:   </devices>
Nov 07 04:09:15 user nova-compute[74540]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 07 04:09:15 user nova-compute[74540]:     <label>libvirt-332796aa-adda-40ef-8650-126641e30821</label>
Nov 07 04:09:15 user nova-compute[74540]:     <imagelabel>libvirt-332796aa-adda-40ef-8650-126641e30821</imagelabel>
Nov 07 04:09:15 user nova-compute[74540]:   </seclabel>
Nov 07 04:09:15 user nova-compute[74540]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 07 04:09:15 user nova-compute[74540]:     <label>+64055:+108</label>
Nov 07 04:09:15 user nova-compute[74540]:     <imagelabel>+64055:+108</imagelabel>
Nov 07 04:09:15 user nova-compute[74540]:   </seclabel>
Nov 07 04:09:15 user nova-compute[74540]: </domain>
Nov 07 04:09:15 user nova-compute[74540]:  {{(pid=74540) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:cd:be:e0"/><model type="virtio"/><mtu size="1442"/><target dev="tap69c97beb-2b"/></interface> {{(pid=74540) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:cd:be:e0"/><model type="virtio"/><mtu size="1442"/><target dev="tap69c97beb-2b"/></interface>not found in domain: <domain type='kvm' id='29'>
Nov 07 04:09:15 user nova-compute[74540]:   <name>instance-00000016</name>
Nov 07 04:09:15 user nova-compute[74540]:   <uuid>332796aa-adda-40ef-8650-126641e30821</uuid>
Nov 07 04:09:15 user nova-compute[74540]:   <metadata>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:09:15 user nova-compute[74540]:   <nova:package version="0.0.0"/>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:name>tempest-device-tagging-server-1583633477</nova:name>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:creationTime>2023-11-07 04:09:15</nova:creationTime>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:flavor name="m1.tiny">
Nov 07 04:09:15 user nova-compute[74540]:     <nova:memory>512</nova:memory>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:disk>1</nova:disk>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:swap>0</nova:swap>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:vcpus>1</nova:vcpus>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:flavor>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:owner>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:user uuid="f469ca83fe184f1698ed812016fb5b64">tempest-TaggedAttachmentsTest-793581715-project-member</nova:user>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:project uuid="ac7b6c7a58f842129f0f27294085214a">tempest-TaggedAttachmentsTest-793581715</nova:project>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:owner>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:ports>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:port uuid="abb88c7a-347e-428e-8069-d2419ed701c3">
Nov 07 04:09:15 user nova-compute[74540]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:09:15 user nova-compute[74540]:     </nova:port>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:ports>
Nov 07 04:09:15 user nova-compute[74540]: </nova:instance>
Nov 07 04:09:15 user nova-compute[74540]:   </metadata>
Nov 07 04:09:15 user nova-compute[74540]:   <memory unit='KiB'>524288</memory>
Nov 07 04:09:15 user nova-compute[74540]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 07 04:09:15 user nova-compute[74540]:   <vcpu placement='static'>1</vcpu>
Nov 07 04:09:15 user nova-compute[74540]:   <resource>
Nov 07 04:09:15 user nova-compute[74540]:     <partition>/machine</partition>
Nov 07 04:09:15 user nova-compute[74540]:   </resource>
Nov 07 04:09:15 user nova-compute[74540]:   <sysinfo type='smbios'>
Nov 07 04:09:15 user nova-compute[74540]:     <system>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='product'>OpenStack Nova</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='version'>0.0.0</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='serial'>332796aa-adda-40ef-8650-126641e30821</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='uuid'>332796aa-adda-40ef-8650-126641e30821</entry>
Nov 07 04:09:15 user nova-compute[74540]:       <entry name='family'>Virtual Machine</entry>
Nov 07 04:09:15 user nova-compute[74540]:     </system>
Nov 07 04:09:15 user nova-compute[74540]:   </sysinfo>
Nov 07 04:09:15 user nova-compute[74540]:   <os>
Nov 07 04:09:15 user nova-compute[74540]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 07 04:09:15 user nova-compute[74540]:     <boot dev='hd'/>
Nov 07 04:09:15 user nova-compute[74540]:     <smbios mode='sysinfo'/>
Nov 07 04:09:15 user nova-compute[74540]:   </os>
Nov 07 04:09:15 user nova-compute[74540]:   <features>
Nov 07 04:09:15 user nova-compute[74540]:     <acpi/>
Nov 07 04:09:15 user nova-compute[74540]:     <apic/>
Nov 07 04:09:15 user nova-compute[74540]:     <vmcoreinfo state='on'/>
Nov 07 04:09:15 user nova-compute[74540]:   </features>
Nov 07 04:09:15 user nova-compute[74540]:   <cpu mode='custom' match='exact' check='full'>
Nov 07 04:09:15 user nova-compute[74540]:     <model fallback='forbid'>Nehalem</model>
Nov 07 04:09:15 user nova-compute[74540]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 07 04:09:15 user nova-compute[74540]:     <feature policy='require' name='vme'/>
Nov 07 04:09:15 user nova-compute[74540]:     <feature policy='require' name='x2apic'/>
Nov 07 04:09:15 user nova-compute[74540]:     <feature policy='require' name='hypervisor'/>
Nov 07 04:09:15 user nova-compute[74540]:   </cpu>
Nov 07 04:09:15 user nova-compute[74540]:   <clock offset='utc'>
Nov 07 04:09:15 user nova-compute[74540]:     <timer name='pit' tickpolicy='delay'/>
Nov 07 04:09:15 user nova-compute[74540]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 07 04:09:15 user nova-compute[74540]:     <timer name='hpet' present='no'/>
Nov 07 04:09:15 user nova-compute[74540]:   </clock>
Nov 07 04:09:15 user nova-compute[74540]:   <on_poweroff>destroy</on_poweroff>
Nov 07 04:09:15 user nova-compute[74540]:   <on_reboot>restart</on_reboot>
Nov 07 04:09:15 user nova-compute[74540]:   <on_crash>destroy</on_crash>
Nov 07 04:09:15 user nova-compute[74540]:   <devices>
Nov 07 04:09:15 user nova-compute[74540]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 07 04:09:15 user nova-compute[74540]:     <disk type='file' device='disk'>
Nov 07 04:09:15 user nova-compute[74540]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 07 04:09:15 user nova-compute[74540]:       <source file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk' index='2'/>
Nov 07 04:09:15 user nova-compute[74540]:       <backingStore type='file' index='3'>
Nov 07 04:09:15 user nova-compute[74540]:         <format type='raw'/>
Nov 07 04:09:15 user nova-compute[74540]:         <source file='/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c'/>
Nov 07 04:09:15 user nova-compute[74540]:         <backingStore/>
Nov 07 04:09:15 user nova-compute[74540]:       </backingStore>
Nov 07 04:09:15 user nova-compute[74540]:       <target dev='vda' bus='virtio'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='virtio-disk0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </disk>
Nov 07 04:09:15 user nova-compute[74540]:     <disk type='file' device='cdrom'>
Nov 07 04:09:15 user nova-compute[74540]:       <driver name='qemu' type='raw' cache='none'/>
Nov 07 04:09:15 user nova-compute[74540]:       <source file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk.config' index='1'/>
Nov 07 04:09:15 user nova-compute[74540]:       <backingStore/>
Nov 07 04:09:15 user nova-compute[74540]:       <target dev='hda' bus='ide'/>
Nov 07 04:09:15 user nova-compute[74540]:       <readonly/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='ide0-0-0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </disk>
Nov 07 04:09:15 user nova-compute[74540]:     <controller type='usb' index='0' model='none'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='usb'/>
Nov 07 04:09:15 user nova-compute[74540]:     </controller>
Nov 07 04:09:15 user nova-compute[74540]:     <controller type='pci' index='0' model='pci-root'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='pci.0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </controller>
Nov 07 04:09:15 user nova-compute[74540]:     <controller type='ide' index='0'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='ide'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 07 04:09:15 user nova-compute[74540]:     </controller>
Nov 07 04:09:15 user nova-compute[74540]:     <interface type='ethernet'>
Nov 07 04:09:15 user nova-compute[74540]:       <mac address='fa:16:3e:2e:77:3f'/>
Nov 07 04:09:15 user nova-compute[74540]:       <target dev='tapabb88c7a-34'/>
Nov 07 04:09:15 user nova-compute[74540]:       <model type='virtio'/>
Nov 07 04:09:15 user nova-compute[74540]:       <mtu size='1442'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='net0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </interface>
Nov 07 04:09:15 user nova-compute[74540]:     <serial type='pty'>
Nov 07 04:09:15 user nova-compute[74540]:       <source path='/dev/pts/4'/>
Nov 07 04:09:15 user nova-compute[74540]:       <log file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/console.log' append='off'/>
Nov 07 04:09:15 user nova-compute[74540]:       <target type='isa-serial' port='0'>
Nov 07 04:09:15 user nova-compute[74540]:         <model name='isa-serial'/>
Nov 07 04:09:15 user nova-compute[74540]:       </target>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='serial0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </serial>
Nov 07 04:09:15 user nova-compute[74540]:     <console type='pty' tty='/dev/pts/4'>
Nov 07 04:09:15 user nova-compute[74540]:       <source path='/dev/pts/4'/>
Nov 07 04:09:15 user nova-compute[74540]:       <log file='/opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/console.log' append='off'/>
Nov 07 04:09:15 user nova-compute[74540]:       <target type='serial' port='0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='serial0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </console>
Nov 07 04:09:15 user nova-compute[74540]:     <input type='mouse' bus='ps2'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='input0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </input>
Nov 07 04:09:15 user nova-compute[74540]:     <input type='keyboard' bus='ps2'>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='input1'/>
Nov 07 04:09:15 user nova-compute[74540]:     </input>
Nov 07 04:09:15 user nova-compute[74540]:     <graphics type='vnc' port='5903' autoport='yes' listen='0.0.0.0'>
Nov 07 04:09:15 user nova-compute[74540]:       <listen type='address' address='0.0.0.0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </graphics>
Nov 07 04:09:15 user nova-compute[74540]:     <audio id='1' type='none'/>
Nov 07 04:09:15 user nova-compute[74540]:     <video>
Nov 07 04:09:15 user nova-compute[74540]:       <model type='virtio' heads='1' primary='yes'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='video0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </video>
Nov 07 04:09:15 user nova-compute[74540]:     <memballoon model='virtio'>
Nov 07 04:09:15 user nova-compute[74540]:       <stats period='10'/>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='balloon0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </memballoon>
Nov 07 04:09:15 user nova-compute[74540]:     <rng model='virtio'>
Nov 07 04:09:15 user nova-compute[74540]:       <backend model='random'>/dev/urandom</backend>
Nov 07 04:09:15 user nova-compute[74540]:       <alias name='rng0'/>
Nov 07 04:09:15 user nova-compute[74540]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 07 04:09:15 user nova-compute[74540]:     </rng>
Nov 07 04:09:15 user nova-compute[74540]:   </devices>
Nov 07 04:09:15 user nova-compute[74540]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 07 04:09:15 user nova-compute[74540]:     <label>libvirt-332796aa-adda-40ef-8650-126641e30821</label>
Nov 07 04:09:15 user nova-compute[74540]:     <imagelabel>libvirt-332796aa-adda-40ef-8650-126641e30821</imagelabel>
Nov 07 04:09:15 user nova-compute[74540]:   </seclabel>
Nov 07 04:09:15 user nova-compute[74540]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 07 04:09:15 user nova-compute[74540]:     <label>+64055:+108</label>
Nov 07 04:09:15 user nova-compute[74540]:     <imagelabel>+64055:+108</imagelabel>
Nov 07 04:09:15 user nova-compute[74540]:   </seclabel>
Nov 07 04:09:15 user nova-compute[74540]: </domain>
Nov 07 04:09:15 user nova-compute[74540]:  {{(pid=74540) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 07 04:09:15 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Detaching interface fa:16:3e:cd:be:e0 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap69c97beb-2b' not found.
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T04:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583633477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583633477',id=22,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7qsXSGLs+mC92IhCOo9fu/hTPQ5t1+AS7uJm7dv0HXMtIsNXU9ojGEHLtMbGRbnw9Yr5blprgPfBKlEZhTtmiDGlxqbo6WyQ4dq718r+8MLhSRzzyL2Hp9P9gMScDwtA==',key_name='tempest-keypair-1229377363',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac7b6c7a58f842129f0f27294085214a',ramdisk_id='',reservation_id='r-l9bskaef',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-793581715',owner_user_name='tempest-TaggedAttachmentsTest-793581715-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f469ca83fe184f1698ed812016fb5b64',uuid=332796aa-adda-40ef-8650-126641e30821,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] Converting VIF {"id": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "address": "fa:16:3e:cd:be:e0", "network": {"id": "a79bd329-e3be-44f3-975e-869368c6b5f2", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1729983294", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c97beb-2b", "ovs_interfaceid": "69c97beb-2ba9-428a-abcd-8a17f4bf3c1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=69c97beb-2ba9-428a-abcd-8a17f4bf3c1b,network=Network(a79bd329-e3be-44f3-975e-869368c6b5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c97beb-2b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG os_vif [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=69c97beb-2ba9-428a-abcd-8a17f4bf3c1b,network=Network(a79bd329-e3be-44f3-975e-869368c6b5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c97beb-2b') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69c97beb-2b, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:09:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:09:15 user nova-compute[74540]: INFO os_vif [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:be:e0,bridge_name='br-int',has_traffic_filtering=True,id=69c97beb-2ba9-428a-abcd-8a17f4bf3c1b,network=Network(a79bd329-e3be-44f3-975e-869368c6b5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c97beb-2b')
Nov 07 04:09:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [req-982a5b9f-3833-4a5f-839f-a0db980f8d7c req-23cf7966-bf19-44b6-b783-5d4e434e9c43 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:09:15 user nova-compute[74540]:   <nova:package version="0.0.0"/>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:name>tempest-device-tagging-server-1583633477</nova:name>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:creationTime>2023-11-07 04:09:15</nova:creationTime>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:flavor name="m1.tiny">
Nov 07 04:09:15 user nova-compute[74540]:     <nova:memory>512</nova:memory>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:disk>1</nova:disk>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:swap>0</nova:swap>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:vcpus>1</nova:vcpus>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:flavor>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:owner>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:user uuid="f469ca83fe184f1698ed812016fb5b64">tempest-TaggedAttachmentsTest-793581715-project-member</nova:user>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:project uuid="ac7b6c7a58f842129f0f27294085214a">tempest-TaggedAttachmentsTest-793581715</nova:project>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:owner>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:09:15 user nova-compute[74540]:   <nova:ports>
Nov 07 04:09:15 user nova-compute[74540]:     <nova:port uuid="abb88c7a-347e-428e-8069-d2419ed701c3">
Nov 07 04:09:15 user nova-compute[74540]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:09:15 user nova-compute[74540]:     </nova:port>
Nov 07 04:09:15 user nova-compute[74540]:   </nova:ports>
Nov 07 04:09:15 user nova-compute[74540]: </nova:instance>
Nov 07 04:09:15 user nova-compute[74540]:  {{(pid=74540) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 07 04:09:16 user nova-compute[74540]: INFO nova.network.neutron [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Port 69c97beb-2ba9-428a-abcd-8a17f4bf3c1b from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 07 04:09:16 user nova-compute[74540]: DEBUG nova.network.neutron [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Updating instance_info_cache with network_info: [{"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:09:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Releasing lock "refresh_cache-332796aa-adda-40ef-8650-126641e30821" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:09:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-648f1007-70e4-45ac-bb8e-e3e594c6a0d5 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "interface-332796aa-adda-40ef-8650-126641e30821-69c97beb-2ba9-428a-abcd-8a17f4bf3c1b" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.659s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:22 user nova-compute[74540]: INFO nova.compute.manager [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Detaching volume 5b341039-9c2b-41c2-8276-0b304d2bbb5c
Nov 07 04:09:22 user nova-compute[74540]: INFO nova.virt.block_device [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Attempting to driver detach volume 5b341039-9c2b-41c2-8276-0b304d2bbb5c from mountpoint /dev/vdc
Nov 07 04:09:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Attempting to detach device vdc from instance 6b84cdaa-6964-4e16-95b3-accb9086d871 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:09:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:09:22 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:09:22 user nova-compute[74540]:   <source dev="/dev/sde"/>
Nov 07 04:09:22 user nova-compute[74540]:   <target dev="vdc" bus="virtio"/>
Nov 07 04:09:22 user nova-compute[74540]:   <serial>5b341039-9c2b-41c2-8276-0b304d2bbb5c</serial>
Nov 07 04:09:22 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 04:09:22 user nova-compute[74540]: </disk>
Nov 07 04:09:22 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:09:22 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Successfully detached device vdc from instance 6b84cdaa-6964-4e16-95b3-accb9086d871 from the persistent domain config.
Nov 07 04:09:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6b84cdaa-6964-4e16-95b3-accb9086d871 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:09:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:09:22 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:09:22 user nova-compute[74540]:   <source dev="/dev/sde"/>
Nov 07 04:09:22 user nova-compute[74540]:   <target dev="vdc" bus="virtio"/>
Nov 07 04:09:22 user nova-compute[74540]:   <serial>5b341039-9c2b-41c2-8276-0b304d2bbb5c</serial>
Nov 07 04:09:22 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 04:09:22 user nova-compute[74540]: </disk>
Nov 07 04:09:22 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:09:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6b84cdaa-6964-4e16-95b3-accb9086d871 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:09:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:09:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:26 user nova-compute[74540]: INFO nova.compute.manager [None req-401a238a-4a3d-4c6e-911a-d30b3b589069 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Unrescuing
Nov 07 04:09:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-401a238a-4a3d-4c6e-911a-d30b3b589069 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:09:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-401a238a-4a3d-4c6e-911a-d30b3b589069 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquired lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:09:26 user nova-compute[74540]: DEBUG nova.network.neutron [None req-401a238a-4a3d-4c6e-911a-d30b3b589069 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:09:26 user nova-compute[74540]: DEBUG nova.network.neutron [None req-401a238a-4a3d-4c6e-911a-d30b3b589069 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updating instance_info_cache with network_info: [{"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:09:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-401a238a-4a3d-4c6e-911a-d30b3b589069 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Releasing lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:09:26 user nova-compute[74540]: DEBUG nova.objects.instance [None req-401a238a-4a3d-4c6e-911a-d30b3b589069 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'flavor' on Instance uuid d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:09:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-e0ee937b-401b-4110-88ee-a3bd53156cfb req-26c72899-a417-4087-b74c-143b0415bcab service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-vif-unplugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:09:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e0ee937b-401b-4110-88ee-a3bd53156cfb req-26c72899-a417-4087-b74c-143b0415bcab service nova] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e0ee937b-401b-4110-88ee-a3bd53156cfb req-26c72899-a417-4087-b74c-143b0415bcab service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e0ee937b-401b-4110-88ee-a3bd53156cfb req-26c72899-a417-4087-b74c-143b0415bcab service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-e0ee937b-401b-4110-88ee-a3bd53156cfb req-26c72899-a417-4087-b74c-143b0415bcab service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] No waiting events found dispatching network-vif-unplugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:09:27 user nova-compute[74540]: WARNING nova.compute.manager [req-e0ee937b-401b-4110-88ee-a3bd53156cfb req-26c72899-a417-4087-b74c-143b0415bcab service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received unexpected event network-vif-unplugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:09:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:27 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Instance destroyed successfully.
Nov 07 04:09:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-3713450d-284a-413e-9d3e-45675205ae82 req-cd21849b-8022-4759-bd59-6110c6539a5f service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:09:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3713450d-284a-413e-9d3e-45675205ae82 req-cd21849b-8022-4759-bd59-6110c6539a5f service nova] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3713450d-284a-413e-9d3e-45675205ae82 req-cd21849b-8022-4759-bd59-6110c6539a5f service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3713450d-284a-413e-9d3e-45675205ae82 req-cd21849b-8022-4759-bd59-6110c6539a5f service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-3713450d-284a-413e-9d3e-45675205ae82 req-cd21849b-8022-4759-bd59-6110c6539a5f service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] No waiting events found dispatching network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:09:29 user nova-compute[74540]: WARNING nova.compute.manager [req-3713450d-284a-413e-9d3e-45675205ae82 req-cd21849b-8022-4759-bd59-6110c6539a5f service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received unexpected event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:09:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-9db53b04-2f74-4f3d-acf5-985b98b0a858 req-337a8595-34aa-4a1b-9cd1-ccfd59a20c1f service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:09:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9db53b04-2f74-4f3d-acf5-985b98b0a858 req-337a8595-34aa-4a1b-9cd1-ccfd59a20c1f service nova] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9db53b04-2f74-4f3d-acf5-985b98b0a858 req-337a8595-34aa-4a1b-9cd1-ccfd59a20c1f service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9db53b04-2f74-4f3d-acf5-985b98b0a858 req-337a8595-34aa-4a1b-9cd1-ccfd59a20c1f service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-9db53b04-2f74-4f3d-acf5-985b98b0a858 req-337a8595-34aa-4a1b-9cd1-ccfd59a20c1f service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] No waiting events found dispatching network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:09:31 user nova-compute[74540]: WARNING nova.compute.manager [req-9db53b04-2f74-4f3d-acf5-985b98b0a858 req-337a8595-34aa-4a1b-9cd1-ccfd59a20c1f service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received unexpected event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:09:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-9db53b04-2f74-4f3d-acf5-985b98b0a858 req-337a8595-34aa-4a1b-9cd1-ccfd59a20c1f service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:09:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9db53b04-2f74-4f3d-acf5-985b98b0a858 req-337a8595-34aa-4a1b-9cd1-ccfd59a20c1f service nova] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9db53b04-2f74-4f3d-acf5-985b98b0a858 req-337a8595-34aa-4a1b-9cd1-ccfd59a20c1f service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9db53b04-2f74-4f3d-acf5-985b98b0a858 req-337a8595-34aa-4a1b-9cd1-ccfd59a20c1f service nova] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-9db53b04-2f74-4f3d-acf5-985b98b0a858 req-337a8595-34aa-4a1b-9cd1-ccfd59a20c1f service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] No waiting events found dispatching network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:09:31 user nova-compute[74540]: WARNING nova.compute.manager [req-9db53b04-2f74-4f3d-acf5-985b98b0a858 req-337a8595-34aa-4a1b-9cd1-ccfd59a20c1f service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received unexpected event network-vif-plugged-82decd3b-b1ba-4b4c-88ab-fbae31e34394 for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:09:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-401a238a-4a3d-4c6e-911a-d30b3b589069 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:09:31 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:09:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:35 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:09:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:38 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:09:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:09:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:09:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:09:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6b84cdaa-6964-4e16-95b3-accb9086d871 is timed out.
Nov 07 04:09:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Successfully detached device vdc from instance 6b84cdaa-6964-4e16-95b3-accb9086d871 from the live domain config.
Nov 07 04:09:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBcSiPxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:09:42 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b3d12e-5aa6-42f4-b813-f895c7838cb0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:09:42 user nova-compute[74540]: No targets found.
Nov 07 04:09:42 user nova-compute[74540]: iSNS:
Nov 07 04:09:42 user nova-compute[74540]: No targets found.
Nov 07 04:09:42 user nova-compute[74540]: STATIC:
Nov 07 04:09:42 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598
Nov 07 04:09:42 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:09:42 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:09:42 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814
Nov 07 04:09:42 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:09:42 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:09:42 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a
Nov 07 04:09:42 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:09:42 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:09:42 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c
Nov 07 04:09:42 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:09:42 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:09:42 user nova-compute[74540]: FIRMWARE:
Nov 07 04:09:42 user nova-compute[74540]: No targets found.
Nov 07 04:09:42 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:09:42 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:09:42 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9db8e8c-fb59-4bcb-b30d-ec88e3e16c0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[74799ad8-9ee1-47c3-aa18-bb9d0d02f162]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:09:42 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:09:42 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:09:42 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:09:42 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:09:42 user nova-compute[74540]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c (non-flash)
Nov 07 04:09:42 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:09:42 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:09:42 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc14cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c'): ({'sde'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Removing single pathed devices sde {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c47afa6-998a-467e-9f16-69bd7a0337fc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90c145d-4858-48ce-947b-e64a8e66f1af]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Flushing IO for device /dev/sde {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[23af2157-f5b4-4bbc-af80-2067983fb9a4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[92080973-afd7-49a7-81a2-eb81ff2ebc8e]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] SCSI volumes sde have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f2ff55-543e-46de-af03-746037a4c912]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:09:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e064ce-b9e6-4ede-8a67-a0ac81ef37a9]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c, portal: 172.16.0.220,3260]
Nov 07 04:09:43 user nova-compute[74540]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c, portal: 172.16.0.220,3260] successful.
Nov 07 04:09:43 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b341039-9c2b-41c2-8276-0b304d2bbb5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed480612-8711-427b-a0cd-6f3e1fa67a7f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] <== disconnect_volume: return (384ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:44 user nova-compute[74540]: DEBUG nova.objects.instance [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'flavor' on Instance uuid 6b84cdaa-6964-4e16-95b3-accb9086d871 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:09:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-199eab57-b4cb-4bc6-b475-45afeb0efca6 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.173s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:09:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:45 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:09:45 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7554MB free_disk=25.011333465576172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d61ec49c-3345-4808-bfcd-a9d925fe1918 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 332796aa-adda-40ef-8650-126641e30821 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 6b84cdaa-6964-4e16-95b3-accb9086d871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "332796aa-adda-40ef-8650-126641e30821" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "332796aa-adda-40ef-8650-126641e30821" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "332796aa-adda-40ef-8650-126641e30821-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "332796aa-adda-40ef-8650-126641e30821-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "332796aa-adda-40ef-8650-126641e30821-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:45 user nova-compute[74540]: INFO nova.compute.manager [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Terminating instance
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.manager [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:09:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-0d9c8d6c-11a5-4cb4-9fe0-700be4829dcd req-aec09143-06aa-4df4-ab68-9d88a3f63ffe service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-vif-unplugged-abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0d9c8d6c-11a5-4cb4-9fe0-700be4829dcd req-aec09143-06aa-4df4-ab68-9d88a3f63ffe service nova] Acquiring lock "332796aa-adda-40ef-8650-126641e30821-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0d9c8d6c-11a5-4cb4-9fe0-700be4829dcd req-aec09143-06aa-4df4-ab68-9d88a3f63ffe service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0d9c8d6c-11a5-4cb4-9fe0-700be4829dcd req-aec09143-06aa-4df4-ab68-9d88a3f63ffe service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-0d9c8d6c-11a5-4cb4-9fe0-700be4829dcd req-aec09143-06aa-4df4-ab68-9d88a3f63ffe service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] No waiting events found dispatching network-vif-unplugged-abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-0d9c8d6c-11a5-4cb4-9fe0-700be4829dcd req-aec09143-06aa-4df4-ab68-9d88a3f63ffe service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-vif-unplugged-abb88c7a-347e-428e-8069-d2419ed701c3 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:09:46 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 332796aa-adda-40ef-8650-126641e30821] Instance destroyed successfully.
Nov 07 04:09:46 user nova-compute[74540]: DEBUG nova.objects.instance [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lazy-loading 'resources' on Instance uuid 332796aa-adda-40ef-8650-126641e30821 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-07T04:05:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583633477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583633477',id=22,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7qsXSGLs+mC92IhCOo9fu/hTPQ5t1+AS7uJm7dv0HXMtIsNXU9ojGEHLtMbGRbnw9Yr5blprgPfBKlEZhTtmiDGlxqbo6WyQ4dq718r+8MLhSRzzyL2Hp9P9gMScDwtA==',key_name='tempest-keypair-1229377363',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac7b6c7a58f842129f0f27294085214a',ramdisk_id='',reservation_id='r-l9bskaef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-793581715',owner_user_name='tempest-TaggedAttachmentsTest-793581715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f469ca83fe184f1698ed812016fb5b64',uuid=332796aa-adda-40ef-8650-126641e30821,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converting VIF {"id": "abb88c7a-347e-428e-8069-d2419ed701c3", "address": "fa:16:3e:2e:77:3f", "network": {"id": "d457440c-d143-48a1-bb7c-231fad9d0448", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-902894523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac7b6c7a58f842129f0f27294085214a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabb88c7a-34", "ovs_interfaceid": "abb88c7a-347e-428e-8069-d2419ed701c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:77:3f,bridge_name='br-int',has_traffic_filtering=True,id=abb88c7a-347e-428e-8069-d2419ed701c3,network=Network(d457440c-d143-48a1-bb7c-231fad9d0448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb88c7a-34') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG os_vif [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:77:3f,bridge_name='br-int',has_traffic_filtering=True,id=abb88c7a-347e-428e-8069-d2419ed701c3,network=Network(d457440c-d143-48a1-bb7c-231fad9d0448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb88c7a-34') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabb88c7a-34, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2af3331-4d28-477a-86b1-1f2411b9695d) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:46 user nova-compute[74540]: INFO os_vif [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:77:3f,bridge_name='br-int',has_traffic_filtering=True,id=abb88c7a-347e-428e-8069-d2419ed701c3,network=Network(d457440c-d143-48a1-bb7c-231fad9d0448),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabb88c7a-34')
Nov 07 04:09:46 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Deleting instance files /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821_del
Nov 07 04:09:46 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Deletion of /opt/stack/data/nova/instances/332796aa-adda-40ef-8650-126641e30821_del complete
Nov 07 04:09:46 user nova-compute[74540]: INFO nova.compute.manager [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] [instance: 332796aa-adda-40ef-8650-126641e30821] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 07 04:09:46 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 332796aa-adda-40ef-8650-126641e30821] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 332796aa-adda-40ef-8650-126641e30821] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:09:46 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:09:47 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 332796aa-adda-40ef-8650-126641e30821] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:09:47 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 332796aa-adda-40ef-8650-126641e30821] Took 1.51 seconds to deallocate network for instance.
Nov 07 04:09:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-0e8c9e23-71fb-483c-95c2-3ef4a07da4ea req-3785fceb-e097-4296-9a88-9f7526450318 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-vif-plugged-abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0e8c9e23-71fb-483c-95c2-3ef4a07da4ea req-3785fceb-e097-4296-9a88-9f7526450318 service nova] Acquiring lock "332796aa-adda-40ef-8650-126641e30821-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0e8c9e23-71fb-483c-95c2-3ef4a07da4ea req-3785fceb-e097-4296-9a88-9f7526450318 service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0e8c9e23-71fb-483c-95c2-3ef4a07da4ea req-3785fceb-e097-4296-9a88-9f7526450318 service nova] Lock "332796aa-adda-40ef-8650-126641e30821-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-0e8c9e23-71fb-483c-95c2-3ef4a07da4ea req-3785fceb-e097-4296-9a88-9f7526450318 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] No waiting events found dispatching network-vif-plugged-abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:09:48 user nova-compute[74540]: WARNING nova.compute.manager [req-0e8c9e23-71fb-483c-95c2-3ef4a07da4ea req-3785fceb-e097-4296-9a88-9f7526450318 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received unexpected event network-vif-plugged-abb88c7a-347e-428e-8069-d2419ed701c3 for instance with vm_state active and task_state deleting.
Nov 07 04:09:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-0e8c9e23-71fb-483c-95c2-3ef4a07da4ea req-3785fceb-e097-4296-9a88-9f7526450318 service nova] [instance: 332796aa-adda-40ef-8650-126641e30821] Received event network-vif-deleted-abb88c7a-347e-428e-8069-d2419ed701c3 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "d8608e1a-77c6-4156-812b-e73012d0b2d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.162s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:09:48 user nova-compute[74540]: INFO nova.compute.claims [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Claim successful on node user
Nov 07 04:09:48 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Deleted allocations for instance 332796aa-adda-40ef-8650-126641e30821
Nov 07 04:09:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76f85c26-d21c-44ee-9770-2e710190e9a9 tempest-TaggedAttachmentsTest-793581715 tempest-TaggedAttachmentsTest-793581715-project-member] Lock "332796aa-adda-40ef-8650-126641e30821" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.192s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:09:49 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:09:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG nova.policy [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19215be651f54d5aa160548205a6dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13ca54283e24792a14346398c50e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:09:49 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Creating image(s)
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "/opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "/opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.167s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk 1073741824" returned: 0 in 0.059s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Successfully created port: 3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.174s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:09:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Cannot resize image /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Ensure instance console log exists: /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Successfully updated port: 3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "refresh_cache-d8608e1a-77c6-4156-812b-e73012d0b2d4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquired lock "refresh_cache-d8608e1a-77c6-4156-812b-e73012d0b2d4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-1166cc75-3dc7-4ffd-b71e-a8c6b69c7504 req-b5f88e55-84b1-42e8-8f40-f84ce9fdd960 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Received event network-changed-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-1166cc75-3dc7-4ffd-b71e-a8c6b69c7504 req-b5f88e55-84b1-42e8-8f40-f84ce9fdd960 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Refreshing instance network info cache due to event network-changed-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1166cc75-3dc7-4ffd-b71e-a8c6b69c7504 req-b5f88e55-84b1-42e8-8f40-f84ce9fdd960 service nova] Acquiring lock "refresh_cache-d8608e1a-77c6-4156-812b-e73012d0b2d4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Updating instance_info_cache with network_info: [{"id": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "address": "fa:16:3e:23:1a:f4", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53cd24-2f", "ovs_interfaceid": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Releasing lock "refresh_cache-d8608e1a-77c6-4156-812b-e73012d0b2d4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Instance network_info: |[{"id": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "address": "fa:16:3e:23:1a:f4", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53cd24-2f", "ovs_interfaceid": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1166cc75-3dc7-4ffd-b71e-a8c6b69c7504 req-b5f88e55-84b1-42e8-8f40-f84ce9fdd960 service nova] Acquired lock "refresh_cache-d8608e1a-77c6-4156-812b-e73012d0b2d4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.network.neutron [req-1166cc75-3dc7-4ffd-b71e-a8c6b69c7504 req-b5f88e55-84b1-42e8-8f40-f84ce9fdd960 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Refreshing network info cache for port 3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Start _get_guest_xml network_info=[{"id": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "address": "fa:16:3e:23:1a:f4", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53cd24-2f", "ovs_interfaceid": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:09:50 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:09:50 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:09:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1181306841',display_name='tempest-VolumesActionsTest-instance-1181306841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1181306841',id=25,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13ca54283e24792a14346398c50e8c9',ramdisk_id='',reservation_id='r-ap2z850m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1216468883',owner_user_name='tempest-VolumesActionsTest-1216468883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:09:49Z,user_data=None,user_id='19215be651f54d5aa160548205a6dc93',uuid=d8608e1a-77c6-4156-812b-e73012d0b2d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "address": "fa:16:3e:23:1a:f4", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53cd24-2f", "ovs_interfaceid": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Converting VIF {"id": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "address": "fa:16:3e:23:1a:f4", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53cd24-2f", "ovs_interfaceid": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:f4,bridge_name='br-int',has_traffic_filtering=True,id=3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c53cd24-2f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.objects.instance [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lazy-loading 'pci_devices' on Instance uuid d8608e1a-77c6-4156-812b-e73012d0b2d4 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:09:50 user nova-compute[74540]:   <uuid>d8608e1a-77c6-4156-812b-e73012d0b2d4</uuid>
Nov 07 04:09:50 user nova-compute[74540]:   <name>instance-00000019</name>
Nov 07 04:09:50 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:09:50 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:09:50 user nova-compute[74540]:   <metadata>
Nov 07 04:09:50 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:09:50 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:09:50 user nova-compute[74540]:       <nova:name>tempest-VolumesActionsTest-instance-1181306841</nova:name>
Nov 07 04:09:50 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:09:50</nova:creationTime>
Nov 07 04:09:50 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:09:50 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:09:50 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:09:50 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:09:50 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:09:50 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:09:50 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:09:50 user nova-compute[74540]:       <nova:owner>
Nov 07 04:09:50 user nova-compute[74540]:         <nova:user uuid="19215be651f54d5aa160548205a6dc93">tempest-VolumesActionsTest-1216468883-project-member</nova:user>
Nov 07 04:09:50 user nova-compute[74540]:         <nova:project uuid="b13ca54283e24792a14346398c50e8c9">tempest-VolumesActionsTest-1216468883</nova:project>
Nov 07 04:09:50 user nova-compute[74540]:       </nova:owner>
Nov 07 04:09:50 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:09:50 user nova-compute[74540]:       <nova:ports>
Nov 07 04:09:50 user nova-compute[74540]:         <nova:port uuid="3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5">
Nov 07 04:09:50 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 07 04:09:50 user nova-compute[74540]:         </nova:port>
Nov 07 04:09:50 user nova-compute[74540]:       </nova:ports>
Nov 07 04:09:50 user nova-compute[74540]:     </nova:instance>
Nov 07 04:09:50 user nova-compute[74540]:   </metadata>
Nov 07 04:09:50 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:09:50 user nova-compute[74540]:     <system>
Nov 07 04:09:50 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:09:50 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:09:50 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:09:50 user nova-compute[74540]:       <entry name="serial">d8608e1a-77c6-4156-812b-e73012d0b2d4</entry>
Nov 07 04:09:50 user nova-compute[74540]:       <entry name="uuid">d8608e1a-77c6-4156-812b-e73012d0b2d4</entry>
Nov 07 04:09:50 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:09:50 user nova-compute[74540]:     </system>
Nov 07 04:09:50 user nova-compute[74540]:   </sysinfo>
Nov 07 04:09:50 user nova-compute[74540]:   <os>
Nov 07 04:09:50 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:09:50 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:09:50 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:09:50 user nova-compute[74540]:   </os>
Nov 07 04:09:50 user nova-compute[74540]:   <features>
Nov 07 04:09:50 user nova-compute[74540]:     <acpi/>
Nov 07 04:09:50 user nova-compute[74540]:     <apic/>
Nov 07 04:09:50 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:09:50 user nova-compute[74540]:   </features>
Nov 07 04:09:50 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:09:50 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:09:50 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:09:50 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:09:50 user nova-compute[74540]:   </clock>
Nov 07 04:09:50 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:09:50 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:09:50 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:09:50 user nova-compute[74540]:   </cpu>
Nov 07 04:09:50 user nova-compute[74540]:   <devices>
Nov 07 04:09:50 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:09:50 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:09:50 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk"/>
Nov 07 04:09:50 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:09:50 user nova-compute[74540]:     </disk>
Nov 07 04:09:50 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:09:50 user nova-compute[74540]:       <mac address="fa:16:3e:23:1a:f4"/>
Nov 07 04:09:50 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:09:50 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:09:50 user nova-compute[74540]:       <target dev="tap3c53cd24-2f"/>
Nov 07 04:09:50 user nova-compute[74540]:     </interface>
Nov 07 04:09:50 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:09:50 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/console.log" append="off"/>
Nov 07 04:09:50 user nova-compute[74540]:     </serial>
Nov 07 04:09:50 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:09:50 user nova-compute[74540]:     <video>
Nov 07 04:09:50 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:09:50 user nova-compute[74540]:     </video>
Nov 07 04:09:50 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:09:50 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:09:50 user nova-compute[74540]:     </rng>
Nov 07 04:09:50 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:09:50 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:09:50 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:09:50 user nova-compute[74540]:     </memballoon>
Nov 07 04:09:50 user nova-compute[74540]:   </devices>
Nov 07 04:09:50 user nova-compute[74540]: </domain>
Nov 07 04:09:50 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:09:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1181306841',display_name='tempest-VolumesActionsTest-instance-1181306841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1181306841',id=25,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13ca54283e24792a14346398c50e8c9',ramdisk_id='',reservation_id='r-ap2z850m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1216468883',owner_user_name='tempest-VolumesActionsTest-1216468883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:09:49Z,user_data=None,user_id='19215be651f54d5aa160548205a6dc93',uuid=d8608e1a-77c6-4156-812b-e73012d0b2d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "address": "fa:16:3e:23:1a:f4", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53cd24-2f", "ovs_interfaceid": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Converting VIF {"id": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "address": "fa:16:3e:23:1a:f4", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53cd24-2f", "ovs_interfaceid": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:f4,bridge_name='br-int',has_traffic_filtering=True,id=3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c53cd24-2f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG os_vif [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:f4,bridge_name='br-int',has_traffic_filtering=True,id=3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c53cd24-2f') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6371fe7c-4b1a-53b4-a45a-c79f581a76c3', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c53cd24-2f, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c53cd24-2f, col_values=(('qos', UUID('4b0257a5-bdb4-4eb5-958d-2d5bf3aa3bf2')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c53cd24-2f, col_values=(('external_ids', {'iface-id': '3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:1a:f4', 'vm-uuid': 'd8608e1a-77c6-4156-812b-e73012d0b2d4'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:50 user nova-compute[74540]: INFO os_vif [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:f4,bridge_name='br-int',has_traffic_filtering=True,id=3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c53cd24-2f')
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:09:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] No VIF found with MAC fa:16:3e:23:1a:f4, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:09:51 user nova-compute[74540]: DEBUG nova.network.neutron [req-1166cc75-3dc7-4ffd-b71e-a8c6b69c7504 req-b5f88e55-84b1-42e8-8f40-f84ce9fdd960 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Updated VIF entry in instance network info cache for port 3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:09:51 user nova-compute[74540]: DEBUG nova.network.neutron [req-1166cc75-3dc7-4ffd-b71e-a8c6b69c7504 req-b5f88e55-84b1-42e8-8f40-f84ce9fdd960 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Updating instance_info_cache with network_info: [{"id": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "address": "fa:16:3e:23:1a:f4", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53cd24-2f", "ovs_interfaceid": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:09:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1166cc75-3dc7-4ffd-b71e-a8c6b69c7504 req-b5f88e55-84b1-42e8-8f40-f84ce9fdd960 service nova] Releasing lock "refresh_cache-d8608e1a-77c6-4156-812b-e73012d0b2d4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:09:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-76d348e1-477b-4588-8f58-4083a2b5f179 req-b34abf02-23c7-4618-832a-1679aa325109 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Received event network-vif-plugged-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:09:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-76d348e1-477b-4588-8f58-4083a2b5f179 req-b34abf02-23c7-4618-832a-1679aa325109 service nova] Acquiring lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-76d348e1-477b-4588-8f58-4083a2b5f179 req-b34abf02-23c7-4618-832a-1679aa325109 service nova] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-76d348e1-477b-4588-8f58-4083a2b5f179 req-b34abf02-23c7-4618-832a-1679aa325109 service nova] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-76d348e1-477b-4588-8f58-4083a2b5f179 req-b34abf02-23c7-4618-832a-1679aa325109 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] No waiting events found dispatching network-vif-plugged-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:09:52 user nova-compute[74540]: WARNING nova.compute.manager [req-76d348e1-477b-4588-8f58-4083a2b5f179 req-b34abf02-23c7-4618-832a-1679aa325109 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Received unexpected event network-vif-plugged-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 for instance with vm_state building and task_state spawning.
Nov 07 04:09:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:09:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Instance spawned successfully.
Nov 07 04:09:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:09:54 user nova-compute[74540]: INFO nova.compute.manager [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 07 04:09:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:09:54 user nova-compute[74540]: INFO nova.compute.manager [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Took 6.28 seconds to build instance.
Nov 07 04:09:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bd0c2f43-3274-4a28-994f-2a0befb1ac01 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.405s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-8530e3c2-a85c-41f5-9a2d-b771010c1f17 req-712f74d0-d662-49c6-9eb9-50a65aa7489d service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Received event network-vif-plugged-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8530e3c2-a85c-41f5-9a2d-b771010c1f17 req-712f74d0-d662-49c6-9eb9-50a65aa7489d service nova] Acquiring lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8530e3c2-a85c-41f5-9a2d-b771010c1f17 req-712f74d0-d662-49c6-9eb9-50a65aa7489d service nova] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8530e3c2-a85c-41f5-9a2d-b771010c1f17 req-712f74d0-d662-49c6-9eb9-50a65aa7489d service nova] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:09:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-8530e3c2-a85c-41f5-9a2d-b771010c1f17 req-712f74d0-d662-49c6-9eb9-50a65aa7489d service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] No waiting events found dispatching network-vif-plugged-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:09:54 user nova-compute[74540]: WARNING nova.compute.manager [req-8530e3c2-a85c-41f5-9a2d-b771010c1f17 req-712f74d0-d662-49c6-9eb9-50a65aa7489d service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Received unexpected event network-vif-plugged-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 for instance with vm_state active and task_state None.
Nov 07 04:09:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:09:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:01 user nova-compute[74540]: INFO nova.compute.manager [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Detaching volume c3225410-ef51-46ce-b9a3-2cdd6e153598
Nov 07 04:10:01 user nova-compute[74540]: INFO nova.virt.block_device [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Attempting to driver detach volume c3225410-ef51-46ce-b9a3-2cdd6e153598 from mountpoint /dev/vdb
Nov 07 04:10:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Attempting to detach device vdb from instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:10:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:10:01 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:10:01 user nova-compute[74540]:   <source dev="/dev/sdb"/>
Nov 07 04:10:01 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:10:01 user nova-compute[74540]:   <serial>c3225410-ef51-46ce-b9a3-2cdd6e153598</serial>
Nov 07 04:10:01 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 04:10:01 user nova-compute[74540]: </disk>
Nov 07 04:10:01 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:10:01 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully detached device vdb from instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 from the persistent domain config.
Nov 07 04:10:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:10:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:10:01 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:10:01 user nova-compute[74540]:   <source dev="/dev/sdb"/>
Nov 07 04:10:01 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:10:01 user nova-compute[74540]:   <serial>c3225410-ef51-46ce-b9a3-2cdd6e153598</serial>
Nov 07 04:10:01 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 04:10:01 user nova-compute[74540]: </disk>
Nov 07 04:10:01 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:10:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:10:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:12 user nova-compute[74540]: INFO nova.compute.manager [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Terminating instance
Nov 07 04:10:12 user nova-compute[74540]: DEBUG nova.compute.manager [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-9d7d2404-bd1a-4bc1-aa5c-67e0d8b48bb4 req-ec5b22f4-f1f6-4955-8eca-2d0ee247f2da service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-vif-unplugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9d7d2404-bd1a-4bc1-aa5c-67e0d8b48bb4 req-ec5b22f4-f1f6-4955-8eca-2d0ee247f2da service nova] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9d7d2404-bd1a-4bc1-aa5c-67e0d8b48bb4 req-ec5b22f4-f1f6-4955-8eca-2d0ee247f2da service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9d7d2404-bd1a-4bc1-aa5c-67e0d8b48bb4 req-ec5b22f4-f1f6-4955-8eca-2d0ee247f2da service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-9d7d2404-bd1a-4bc1-aa5c-67e0d8b48bb4 req-ec5b22f4-f1f6-4955-8eca-2d0ee247f2da service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] No waiting events found dispatching network-vif-unplugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:10:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-9d7d2404-bd1a-4bc1-aa5c-67e0d8b48bb4 req-ec5b22f4-f1f6-4955-8eca-2d0ee247f2da service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-vif-unplugged-3432fa44-5aef-4f35-bc32-9c41738d5eba for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:10:13 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Instance destroyed successfully.
Nov 07 04:10:13 user nova-compute[74540]: DEBUG nova.objects.instance [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'resources' on Instance uuid 6b84cdaa-6964-4e16-95b3-accb9086d871 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T04:02:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1095963237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1095963237',id=16,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5yy6Ou6kxxgeLhllpuYaf0VwnElOEVwXCvSmoufn/x1hVdPoLTWq/xAccmDfVJm0Pb13vhiJ7+4h/8g8wd6kea82ruX/BzZQdz547wqDGDAIFfvjPZ7iXZGlR7HPfLzA==',key_name='tempest-keypair-660584599',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:07:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='796865203135404b8624363d533ae6fe',ramdisk_id='',reservation_id='r-cso2bngu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952443794',owner_user_name='tempest-AttachVolumeShelveTestJSON-952443794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:07:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fad238078941dba4cc57406b1c69ed',uuid=6b84cdaa-6964-4e16-95b3-accb9086d871,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converting VIF {"id": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "address": "fa:16:3e:bb:84:42", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3432fa44-5a", "ovs_interfaceid": "3432fa44-5aef-4f35-bc32-9c41738d5eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG os_vif [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3432fa44-5a, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de53a538-bb1b-40d1-8f84-29daa9f51b6f) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:10:13 user nova-compute[74540]: INFO os_vif [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:84:42,bridge_name='br-int',has_traffic_filtering=True,id=3432fa44-5aef-4f35-bc32-9c41738d5eba,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3432fa44-5a')
Nov 07 04:10:13 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Deleting instance files /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871_del
Nov 07 04:10:13 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Deletion of /opt/stack/data/nova/instances/6b84cdaa-6964-4e16-95b3-accb9086d871_del complete
Nov 07 04:10:13 user nova-compute[74540]: INFO nova.compute.manager [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 07 04:10:13 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:10:13 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG nova.compute.manager [req-f4d0e39c-5bf4-4d2f-9383-d3472f4e3e77 req-18268046-626a-4797-aa99-7d811b5815ac service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-vif-deleted-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:10:14 user nova-compute[74540]: INFO nova.compute.manager [req-f4d0e39c-5bf4-4d2f-9383-d3472f4e3e77 req-18268046-626a-4797-aa99-7d811b5815ac service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Neutron deleted interface 3432fa44-5aef-4f35-bc32-9c41738d5eba; detaching it from the instance and deleting it from the info cache
Nov 07 04:10:14 user nova-compute[74540]: DEBUG nova.network.neutron [req-f4d0e39c-5bf4-4d2f-9383-d3472f4e3e77 req-18268046-626a-4797-aa99-7d811b5815ac service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:10:14 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Took 0.80 seconds to deallocate network for instance.
Nov 07 04:10:14 user nova-compute[74540]: DEBUG nova.compute.manager [req-f4d0e39c-5bf4-4d2f-9383-d3472f4e3e77 req-18268046-626a-4797-aa99-7d811b5815ac service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Detach interface failed, port_id=3432fa44-5aef-4f35-bc32-9c41738d5eba, reason: Instance 6b84cdaa-6964-4e16-95b3-accb9086d871 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:14 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Deleted allocations for instance 6b84cdaa-6964-4e16-95b3-accb9086d871
Nov 07 04:10:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-162c91f9-4712-40bf-b52c-2459a543ce50 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.212s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG nova.compute.manager [req-1f339328-bfa0-41b6-be4c-9f2e76218869 req-76957864-f2d5-43d8-a004-f56639fcc13c service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received event network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1f339328-bfa0-41b6-be4c-9f2e76218869 req-76957864-f2d5-43d8-a004-f56639fcc13c service nova] Acquiring lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1f339328-bfa0-41b6-be4c-9f2e76218869 req-76957864-f2d5-43d8-a004-f56639fcc13c service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1f339328-bfa0-41b6-be4c-9f2e76218869 req-76957864-f2d5-43d8-a004-f56639fcc13c service nova] Lock "6b84cdaa-6964-4e16-95b3-accb9086d871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG nova.compute.manager [req-1f339328-bfa0-41b6-be4c-9f2e76218869 req-76957864-f2d5-43d8-a004-f56639fcc13c service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] No waiting events found dispatching network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:10:14 user nova-compute[74540]: WARNING nova.compute.manager [req-1f339328-bfa0-41b6-be4c-9f2e76218869 req-76957864-f2d5-43d8-a004-f56639fcc13c service nova] [instance: 6b84cdaa-6964-4e16-95b3-accb9086d871] Received unexpected event network-vif-plugged-3432fa44-5aef-4f35-bc32-9c41738d5eba for instance with vm_state deleted and task_state None.
Nov 07 04:10:14 user nova-compute[74540]: DEBUG nova.compute.manager [req-4d064a1d-01e9-4efa-992f-fff5591df20c req-d5f9de87-d78a-4912-82b7-20ae0ab60fbf service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Received event network-changed-68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG nova.compute.manager [req-4d064a1d-01e9-4efa-992f-fff5591df20c req-d5f9de87-d78a-4912-82b7-20ae0ab60fbf service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Refreshing instance network info cache due to event network-changed-68a8f22b-c3f1-4575-b2f3-29af6c59af12. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4d064a1d-01e9-4efa-992f-fff5591df20c req-d5f9de87-d78a-4912-82b7-20ae0ab60fbf service nova] Acquiring lock "refresh_cache-5d120b2b-8d1b-4d19-8364-ab4dad61bad3" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4d064a1d-01e9-4efa-992f-fff5591df20c req-d5f9de87-d78a-4912-82b7-20ae0ab60fbf service nova] Acquired lock "refresh_cache-5d120b2b-8d1b-4d19-8364-ab4dad61bad3" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:10:14 user nova-compute[74540]: DEBUG nova.network.neutron [req-4d064a1d-01e9-4efa-992f-fff5591df20c req-d5f9de87-d78a-4912-82b7-20ae0ab60fbf service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Refreshing network info cache for port 68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:10:15 user nova-compute[74540]: DEBUG nova.network.neutron [req-4d064a1d-01e9-4efa-992f-fff5591df20c req-d5f9de87-d78a-4912-82b7-20ae0ab60fbf service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Updated VIF entry in instance network info cache for port 68a8f22b-c3f1-4575-b2f3-29af6c59af12. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:10:15 user nova-compute[74540]: DEBUG nova.network.neutron [req-4d064a1d-01e9-4efa-992f-fff5591df20c req-d5f9de87-d78a-4912-82b7-20ae0ab60fbf service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Updating instance_info_cache with network_info: [{"id": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "address": "fa:16:3e:f7:9f:73", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a8f22b-c3", "ovs_interfaceid": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:10:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4d064a1d-01e9-4efa-992f-fff5591df20c req-d5f9de87-d78a-4912-82b7-20ae0ab60fbf service nova] Releasing lock "refresh_cache-5d120b2b-8d1b-4d19-8364-ab4dad61bad3" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:10:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG nova.objects.instance [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'flavor' on Instance uuid 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:20 user nova-compute[74540]: INFO nova.compute.manager [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Attaching volume 9f881037-2e11-4acd-aea6-0432598f6e0f to /dev/vdb
Nov 07 04:10:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG os_brick.utils [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede62bfd-c314-489e-b944-1635e5641912]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb810d3a-7c6a-4d86-8500-211360ca5954]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[21af36c5-d502-451c-82a6-76e6504c62dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09f68ef-74bc-48f5-9626-738a969da02e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:10:20 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:10:20 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[209971da-d9e7-484e-bbfb-d6d705973f4e]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG os_brick.utils [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:10:20 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Updating existing volume attachment record: cd7130ea-ae6f-4ae1-874b-c37b0a0568d2 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:10:22 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 is timed out.
Nov 07 04:10:22 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully detached device vdb from instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 from the live domain config.
Nov 07 04:10:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sblqKIDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:10:22 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6521e88-5bbe-400b-9c74-2f675964a04b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:10:22 user nova-compute[74540]: No targets found.
Nov 07 04:10:22 user nova-compute[74540]: iSNS:
Nov 07 04:10:22 user nova-compute[74540]: No targets found.
Nov 07 04:10:22 user nova-compute[74540]: STATIC:
Nov 07 04:10:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598
Nov 07 04:10:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:10:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:10:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814
Nov 07 04:10:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:10:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:10:22 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a
Nov 07 04:10:22 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:10:22 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:10:22 user nova-compute[74540]: FIRMWARE:
Nov 07 04:10:22 user nova-compute[74540]: No targets found.
Nov 07 04:10:22 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:10:22 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:10:22 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece01132-64db-4eda-9a80-b240745cd17c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc88d913-cd1e-4a95-ae77-ca87cece1b2b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:10:22 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:10:22 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:10:22 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:10:22 user nova-compute[74540]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 (non-flash)
Nov 07 04:10:22 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:10:22 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee14293760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb36bee-81a5-4b77-8968-6a46d8cd6673]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fd37b6-92ea-4cbb-bca0-e4f922364c1b]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c9f36d-da71-467b-9629-7fc3f732488b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[41407117-180a-4227-af12-8555d1beed51]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[586ba292-9c8f-40be-a2e5-d49f914e7253]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f6766f-4ab3-4ee8-af34-7f0faed9a05b]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260]
Nov 07 04:10:22 user nova-compute[74540]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598, portal: 172.16.0.220,3260] successful.
Nov 07 04:10:22 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3225410-ef51-46ce-b9a3-2cdd6e153598 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab39c7c2-01b3-4eae-9e08-a67adc9b9fe0]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] <== disconnect_volume: return (322ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:10:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:10:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:23 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:10:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ecb2fc5e-d9fe-4125-a5b6-475b1f1e23e6 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.828s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7dc118b8-0bc9-4565-990a-511003883c09 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7dc118b8-0bc9-4565-990a-511003883c09 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7dc118b8-0bc9-4565-990a-511003883c09 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7dc118b8-0bc9-4565-990a-511003883c09 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74540) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7dc118b8-0bc9-4565-990a-511003883c09 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-bdcf9281-97e2-4e9a-81d0-fe5842db76d2 req-b5403ebf-eba8-4b41-80ab-a80cab7b1795 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-unplugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bdcf9281-97e2-4e9a-81d0-fe5842db76d2 req-b5403ebf-eba8-4b41-80ab-a80cab7b1795 service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bdcf9281-97e2-4e9a-81d0-fe5842db76d2 req-b5403ebf-eba8-4b41-80ab-a80cab7b1795 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bdcf9281-97e2-4e9a-81d0-fe5842db76d2 req-b5403ebf-eba8-4b41-80ab-a80cab7b1795 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-bdcf9281-97e2-4e9a-81d0-fe5842db76d2 req-b5403ebf-eba8-4b41-80ab-a80cab7b1795 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-unplugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:10:24 user nova-compute[74540]: WARNING nova.compute.manager [req-bdcf9281-97e2-4e9a-81d0-fe5842db76d2 req-b5403ebf-eba8-4b41-80ab-a80cab7b1795 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-unplugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state active and task_state powering-off.
Nov 07 04:10:24 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance destroyed successfully.
Nov 07 04:10:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7dc118b8-0bc9-4565-990a-511003883c09 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:10:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7dc118b8-0bc9-4565-990a-511003883c09 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.863s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-a46a45e7-46ec-4367-8f6f-4ea49d43814f req-86992c11-54a9-418a-ad51-0df01aa4d324 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:10:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a46a45e7-46ec-4367-8f6f-4ea49d43814f req-86992c11-54a9-418a-ad51-0df01aa4d324 service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a46a45e7-46ec-4367-8f6f-4ea49d43814f req-86992c11-54a9-418a-ad51-0df01aa4d324 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a46a45e7-46ec-4367-8f6f-4ea49d43814f req-86992c11-54a9-418a-ad51-0df01aa4d324 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-a46a45e7-46ec-4367-8f6f-4ea49d43814f req-86992c11-54a9-418a-ad51-0df01aa4d324 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:10:26 user nova-compute[74540]: WARNING nova.compute.manager [req-a46a45e7-46ec-4367-8f6f-4ea49d43814f req-86992c11-54a9-418a-ad51-0df01aa4d324 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state stopped and task_state None.
Nov 07 04:10:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:29 user nova-compute[74540]: INFO nova.compute.manager [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Detaching volume b195147d-b815-42ae-86a8-6a05a4936814
Nov 07 04:10:29 user nova-compute[74540]: INFO nova.virt.block_device [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Attempting to driver detach volume b195147d-b815-42ae-86a8-6a05a4936814 from mountpoint /dev/vdb
Nov 07 04:10:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Attempting to detach device vdb from instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:10:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:10:29 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:10:29 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:10:29 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:10:29 user nova-compute[74540]:   <serial>b195147d-b815-42ae-86a8-6a05a4936814</serial>
Nov 07 04:10:29 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 04:10:29 user nova-compute[74540]: </disk>
Nov 07 04:10:29 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:10:29 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully detached device vdb from instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 from the persistent domain config.
Nov 07 04:10:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:10:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:10:29 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:10:29 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:10:29 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:10:29 user nova-compute[74540]:   <serial>b195147d-b815-42ae-86a8-6a05a4936814</serial>
Nov 07 04:10:29 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 04:10:29 user nova-compute[74540]: </disk>
Nov 07 04:10:29 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:10:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:10:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:33 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:10:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "20aefb10-e25b-4227-ba94-aaa411050d80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "20aefb10-e25b-4227-ba94-aaa411050d80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:35 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:10:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:35 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:10:35 user nova-compute[74540]: INFO nova.compute.claims [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Claim successful on node user
Nov 07 04:10:35 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:10:35 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:10:36 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:10:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG nova.policy [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88c598b2585a41829af42b129ccb51fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682de4430634d9c88abd728196079a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:10:36 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Creating image(s)
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "/opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "/opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "/opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.203s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk 1073741824" returned: 0 in 0.050s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:10:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:37 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Cannot resize image /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:10:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:10:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Ensure instance console log exists: /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:10:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:37 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Successfully created port: e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Successfully updated port: e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "refresh_cache-20aefb10-e25b-4227-ba94-aaa411050d80" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquired lock "refresh_cache-20aefb10-e25b-4227-ba94-aaa411050d80" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.compute.manager [req-b1037943-b9c7-45d9-bbd5-2abf46adf47a req-692ac440-7363-4917-a000-b01acfcd7d65 service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Received event network-changed-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.compute.manager [req-b1037943-b9c7-45d9-bbd5-2abf46adf47a req-692ac440-7363-4917-a000-b01acfcd7d65 service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Refreshing instance network info cache due to event network-changed-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b1037943-b9c7-45d9-bbd5-2abf46adf47a req-692ac440-7363-4917-a000-b01acfcd7d65 service nova] Acquiring lock "refresh_cache-20aefb10-e25b-4227-ba94-aaa411050d80" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.network.neutron [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Updating instance_info_cache with network_info: [{"id": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "address": "fa:16:3e:ea:cb:59", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b49c82-01", "ovs_interfaceid": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Releasing lock "refresh_cache-20aefb10-e25b-4227-ba94-aaa411050d80" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Instance network_info: |[{"id": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "address": "fa:16:3e:ea:cb:59", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b49c82-01", "ovs_interfaceid": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b1037943-b9c7-45d9-bbd5-2abf46adf47a req-692ac440-7363-4917-a000-b01acfcd7d65 service nova] Acquired lock "refresh_cache-20aefb10-e25b-4227-ba94-aaa411050d80" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.network.neutron [req-b1037943-b9c7-45d9-bbd5-2abf46adf47a req-692ac440-7363-4917-a000-b01acfcd7d65 service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Refreshing network info cache for port e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Start _get_guest_xml network_info=[{"id": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "address": "fa:16:3e:ea:cb:59", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b49c82-01", "ovs_interfaceid": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:10:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:10:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-82778165',display_name='tempest-VolumesSnapshotTestJSON-instance-82778165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-82778165',id=26,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9Ehk+azZXXpAmto134LgHBJNQAp258bm9xrDVI1HWG69cEjuF2eqdh6ZaY5PywbMhAbj9him3S5MxVyexU4CLqhXHf1uPDgx5a6aecmTZwl3gGeiES6O+12i9GYXF5HA==',key_name='tempest-keypair-1827399304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b682de4430634d9c88abd728196079a0',ramdisk_id='',reservation_id='r-286cumey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1818707028',owner_user_name='tempest-VolumesSnapshotTestJSON-1818707028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:10:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c598b2585a41829af42b129ccb51fa',uuid=20aefb10-e25b-4227-ba94-aaa411050d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "address": "fa:16:3e:ea:cb:59", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b49c82-01", "ovs_interfaceid": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Converting VIF {"id": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "address": "fa:16:3e:ea:cb:59", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b49c82-01", "ovs_interfaceid": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=e6b49c82-01c9-4c16-90ca-93a9faf2d5a0,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b49c82-01') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.objects.instance [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lazy-loading 'pci_devices' on Instance uuid 20aefb10-e25b-4227-ba94-aaa411050d80 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:10:38 user nova-compute[74540]:   <uuid>20aefb10-e25b-4227-ba94-aaa411050d80</uuid>
Nov 07 04:10:38 user nova-compute[74540]:   <name>instance-0000001a</name>
Nov 07 04:10:38 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:10:38 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:10:38 user nova-compute[74540]:   <metadata>
Nov 07 04:10:38 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:10:38 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:10:38 user nova-compute[74540]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-82778165</nova:name>
Nov 07 04:10:38 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:10:38</nova:creationTime>
Nov 07 04:10:38 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:10:38 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:10:38 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:10:38 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:10:38 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:10:38 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:10:38 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:10:38 user nova-compute[74540]:       <nova:owner>
Nov 07 04:10:38 user nova-compute[74540]:         <nova:user uuid="88c598b2585a41829af42b129ccb51fa">tempest-VolumesSnapshotTestJSON-1818707028-project-member</nova:user>
Nov 07 04:10:38 user nova-compute[74540]:         <nova:project uuid="b682de4430634d9c88abd728196079a0">tempest-VolumesSnapshotTestJSON-1818707028</nova:project>
Nov 07 04:10:38 user nova-compute[74540]:       </nova:owner>
Nov 07 04:10:38 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:10:38 user nova-compute[74540]:       <nova:ports>
Nov 07 04:10:38 user nova-compute[74540]:         <nova:port uuid="e6b49c82-01c9-4c16-90ca-93a9faf2d5a0">
Nov 07 04:10:38 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 07 04:10:38 user nova-compute[74540]:         </nova:port>
Nov 07 04:10:38 user nova-compute[74540]:       </nova:ports>
Nov 07 04:10:38 user nova-compute[74540]:     </nova:instance>
Nov 07 04:10:38 user nova-compute[74540]:   </metadata>
Nov 07 04:10:38 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:10:38 user nova-compute[74540]:     <system>
Nov 07 04:10:38 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:10:38 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:10:38 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:10:38 user nova-compute[74540]:       <entry name="serial">20aefb10-e25b-4227-ba94-aaa411050d80</entry>
Nov 07 04:10:38 user nova-compute[74540]:       <entry name="uuid">20aefb10-e25b-4227-ba94-aaa411050d80</entry>
Nov 07 04:10:38 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:10:38 user nova-compute[74540]:     </system>
Nov 07 04:10:38 user nova-compute[74540]:   </sysinfo>
Nov 07 04:10:38 user nova-compute[74540]:   <os>
Nov 07 04:10:38 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:10:38 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:10:38 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:10:38 user nova-compute[74540]:   </os>
Nov 07 04:10:38 user nova-compute[74540]:   <features>
Nov 07 04:10:38 user nova-compute[74540]:     <acpi/>
Nov 07 04:10:38 user nova-compute[74540]:     <apic/>
Nov 07 04:10:38 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:10:38 user nova-compute[74540]:   </features>
Nov 07 04:10:38 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:10:38 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:10:38 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:10:38 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:10:38 user nova-compute[74540]:   </clock>
Nov 07 04:10:38 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:10:38 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:10:38 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:10:38 user nova-compute[74540]:   </cpu>
Nov 07 04:10:38 user nova-compute[74540]:   <devices>
Nov 07 04:10:38 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:10:38 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:10:38 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk"/>
Nov 07 04:10:38 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:10:38 user nova-compute[74540]:     </disk>
Nov 07 04:10:38 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:10:38 user nova-compute[74540]:       <mac address="fa:16:3e:ea:cb:59"/>
Nov 07 04:10:38 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:10:38 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:10:38 user nova-compute[74540]:       <target dev="tape6b49c82-01"/>
Nov 07 04:10:38 user nova-compute[74540]:     </interface>
Nov 07 04:10:38 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:10:38 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/console.log" append="off"/>
Nov 07 04:10:38 user nova-compute[74540]:     </serial>
Nov 07 04:10:38 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:10:38 user nova-compute[74540]:     <video>
Nov 07 04:10:38 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:10:38 user nova-compute[74540]:     </video>
Nov 07 04:10:38 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:10:38 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:10:38 user nova-compute[74540]:     </rng>
Nov 07 04:10:38 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:10:38 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:10:38 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:10:38 user nova-compute[74540]:     </memballoon>
Nov 07 04:10:38 user nova-compute[74540]:   </devices>
Nov 07 04:10:38 user nova-compute[74540]: </domain>
Nov 07 04:10:38 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-82778165',display_name='tempest-VolumesSnapshotTestJSON-instance-82778165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-82778165',id=26,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9Ehk+azZXXpAmto134LgHBJNQAp258bm9xrDVI1HWG69cEjuF2eqdh6ZaY5PywbMhAbj9him3S5MxVyexU4CLqhXHf1uPDgx5a6aecmTZwl3gGeiES6O+12i9GYXF5HA==',key_name='tempest-keypair-1827399304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b682de4430634d9c88abd728196079a0',ramdisk_id='',reservation_id='r-286cumey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1818707028',owner_user_name='tempest-VolumesSnapshotTestJSON-1818707028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:10:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c598b2585a41829af42b129ccb51fa',uuid=20aefb10-e25b-4227-ba94-aaa411050d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "address": "fa:16:3e:ea:cb:59", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b49c82-01", "ovs_interfaceid": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Converting VIF {"id": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "address": "fa:16:3e:ea:cb:59", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b49c82-01", "ovs_interfaceid": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=e6b49c82-01c9-4c16-90ca-93a9faf2d5a0,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b49c82-01') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG os_vif [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=e6b49c82-01c9-4c16-90ca-93a9faf2d5a0,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b49c82-01') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fcefe7a4-4240-5ca6-a0f7-bd82fe04a1a8', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6b49c82-01, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6b49c82-01, col_values=(('qos', UUID('258af2ba-179c-47a5-9aa3-6761c0c108b9')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6b49c82-01, col_values=(('external_ids', {'iface-id': 'e6b49c82-01c9-4c16-90ca-93a9faf2d5a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:cb:59', 'vm-uuid': '20aefb10-e25b-4227-ba94-aaa411050d80'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:38 user nova-compute[74540]: INFO os_vif [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=e6b49c82-01c9-4c16-90ca-93a9faf2d5a0,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b49c82-01')
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] No VIF found with MAC fa:16:3e:ea:cb:59, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.network.neutron [req-b1037943-b9c7-45d9-bbd5-2abf46adf47a req-692ac440-7363-4917-a000-b01acfcd7d65 service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Updated VIF entry in instance network info cache for port e6b49c82-01c9-4c16-90ca-93a9faf2d5a0. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG nova.network.neutron [req-b1037943-b9c7-45d9-bbd5-2abf46adf47a req-692ac440-7363-4917-a000-b01acfcd7d65 service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Updating instance_info_cache with network_info: [{"id": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "address": "fa:16:3e:ea:cb:59", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b49c82-01", "ovs_interfaceid": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:10:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b1037943-b9c7-45d9-bbd5-2abf46adf47a req-692ac440-7363-4917-a000-b01acfcd7d65 service nova] Releasing lock "refresh_cache-20aefb10-e25b-4227-ba94-aaa411050d80" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-3be37cb1-2782-48d8-83aa-9c327f15d25b req-f5ed184e-5aab-4f7b-8fee-33fd2dddc9b1 service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Received event network-vif-plugged-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3be37cb1-2782-48d8-83aa-9c327f15d25b req-f5ed184e-5aab-4f7b-8fee-33fd2dddc9b1 service nova] Acquiring lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3be37cb1-2782-48d8-83aa-9c327f15d25b req-f5ed184e-5aab-4f7b-8fee-33fd2dddc9b1 service nova] Lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3be37cb1-2782-48d8-83aa-9c327f15d25b req-f5ed184e-5aab-4f7b-8fee-33fd2dddc9b1 service nova] Lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-3be37cb1-2782-48d8-83aa-9c327f15d25b req-f5ed184e-5aab-4f7b-8fee-33fd2dddc9b1 service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] No waiting events found dispatching network-vif-plugged-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:10:40 user nova-compute[74540]: WARNING nova.compute.manager [req-3be37cb1-2782-48d8-83aa-9c327f15d25b req-f5ed184e-5aab-4f7b-8fee-33fd2dddc9b1 service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Received unexpected event network-vif-plugged-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 for instance with vm_state building and task_state spawning.
Nov 07 04:10:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:40 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:10:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Instance spawned successfully.
Nov 07 04:10:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG nova.compute.manager [req-518e41fa-5477-429f-8536-3d99bfba6efb req-ffc87ae1-0633-4381-af1b-16b0fb2ff0ad service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Received event network-vif-plugged-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-518e41fa-5477-429f-8536-3d99bfba6efb req-ffc87ae1-0633-4381-af1b-16b0fb2ff0ad service nova] Acquiring lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-518e41fa-5477-429f-8536-3d99bfba6efb req-ffc87ae1-0633-4381-af1b-16b0fb2ff0ad service nova] Lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-518e41fa-5477-429f-8536-3d99bfba6efb req-ffc87ae1-0633-4381-af1b-16b0fb2ff0ad service nova] Lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG nova.compute.manager [req-518e41fa-5477-429f-8536-3d99bfba6efb req-ffc87ae1-0633-4381-af1b-16b0fb2ff0ad service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] No waiting events found dispatching network-vif-plugged-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:10:42 user nova-compute[74540]: WARNING nova.compute.manager [req-518e41fa-5477-429f-8536-3d99bfba6efb req-ffc87ae1-0633-4381-af1b-16b0fb2ff0ad service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Received unexpected event network-vif-plugged-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 for instance with vm_state building and task_state spawning.
Nov 07 04:10:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:10:42 user nova-compute[74540]: INFO nova.compute.manager [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 07 04:10:42 user nova-compute[74540]: DEBUG nova.compute.manager [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:42 user nova-compute[74540]: INFO nova.compute.manager [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Took 6.92 seconds to build instance.
Nov 07 04:10:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c55acbfa-a2d1-46ac-8f3c-4f13637ae710 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "20aefb10-e25b-4227-ba94-aaa411050d80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.016s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json" returned: 0 in 0.427s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:10:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.274s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:48 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:10:48 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7635MB free_disk=25.02667999267578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d61ec49c-3345-4808-bfcd-a9d925fe1918 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d8608e1a-77c6-4156-812b-e73012d0b2d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 20aefb10-e25b-4227-ba94-aaa411050d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:10:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:49 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 is timed out.
Nov 07 04:10:49 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully detached device vdb from instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 from the live domain config.
Nov 07 04:10:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'thiHvNkD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:10:49 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7077fe-47d0-43f9-9f39-7529be8e9292]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5bdc575-6e3b-4a1d-8617-efa33ce8ec16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:10:49 user nova-compute[74540]: No targets found.
Nov 07 04:10:49 user nova-compute[74540]: iSNS:
Nov 07 04:10:49 user nova-compute[74540]: No targets found.
Nov 07 04:10:49 user nova-compute[74540]: STATIC:
Nov 07 04:10:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:f5bdc575-6e3b-4a1d-8617-efa33ce8ec16
Nov 07 04:10:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:10:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:10:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814
Nov 07 04:10:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:10:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:10:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a
Nov 07 04:10:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:10:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:10:49 user nova-compute[74540]: FIRMWARE:
Nov 07 04:10:49 user nova-compute[74540]: No targets found.
Nov 07 04:10:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:10:49 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:10:49 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d54875-2bb3-4ad0-9376-0832f8145810]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5bdc575-6e3b-4a1d-8617-efa33ce8ec16\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f89914-8f70-42ff-a07c-2e4024bae6af]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5bdc575-6e3b-4a1d-8617-efa33ce8ec16 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:10:49 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:10:49 user nova-compute[74540]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5bdc575-6e3b-4a1d-8617-efa33ce8ec16 (non-flash)
Nov 07 04:10:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:10:49 user nova-compute[74540]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 (non-flash)
Nov 07 04:10:49 user nova-compute[74540]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5bdc575-6e3b-4a1d-8617-efa33ce8ec16 (non-flash)
Nov 07 04:10:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc14e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814'): ({'sdd'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Removing single pathed devices sdd {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ce7bec-7e8f-4932-bc1d-d21157bd44c8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49fe7a7-8ad4-4982-89ac-f0bea6cac00b]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flushing IO for device /dev/sdd {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4816079c-297f-47fc-badf-d02342c771a1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b7f32e-a995-432b-a103-ed851387d983]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1412b14c-95ba-41ce-b2b2-7d1a6142275d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc5c2b2-8b7f-4cfb-9c7c-6814ae6307e4]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260]
Nov 07 04:10:49 user nova-compute[74540]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814, portal: 172.16.0.220,3260] successful.
Nov 07 04:10:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b195147d-b815-42ae-86a8-6a05a4936814 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacd2a43-5aa2-4fb1-ac53-06641617ed64]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== disconnect_volume: return (352ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:10:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:10:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updating instance_info_cache with network_info: [{"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:10:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-22ebfad2-30ec-4f1a-8575-d655d36c6f91" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:10:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:10:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:10:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:10:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:10:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:10:50 user nova-compute[74540]: DEBUG nova.objects.instance [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lazy-loading 'flavor' on Instance uuid 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:10:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-151602e4-03f7-4ad7-8bee-004ca3439ea6 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.894s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCJXaINS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:10:55 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:10:55 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:10:55 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a344cccf-42f6-4426-866d-75f440caf108]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:10:55 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a94728-8a56-4c73-a343-3696a1d8104a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f] added
Nov 07 04:10:55 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c29698e-05a3-47b9-9427-7c61a48ccebd]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d249ac6a-d693-4d1f-aa6f-adfd970542ab]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oCJXaINS {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oCJXaINS" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba0fe2c-33b9-4952-a809-b566a33c6ba8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oCJXaINS'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55baa1b-5221-4233-9cb4-83a80af2ea0a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80ff706-9fc7-442c-bc6e-a1f7111d53bb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5bdc575-6e3b-4a1d-8617-efa33ce8ec16 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:10:55 user nova-compute[74540]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5bdc575-6e3b-4a1d-8617-efa33ce8ec16 (non-flash)
Nov 07 04:10:55 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:10:55 user nova-compute[74540]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5bdc575-6e3b-4a1d-8617-efa33ce8ec16 (non-flash)
Nov 07 04:10:55 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f6e5e9-3e4e-4f0a-82b7-5c2e643b4c31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f, portal: 172.16.0.220,3260]
Nov 07 04:10:55 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f, portal: 172.16.0.220,3260] successful.
Nov 07 04:10:55 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c285df51-58ba-4447-b031-452ab42c2237]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9478c731-5601-4ae7-8465-1919cc8e7a6d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5bdc575-6e3b-4a1d-8617-efa33ce8ec16 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:10:55 user nova-compute[74540]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5bdc575-6e3b-4a1d-8617-efa33ce8ec16 (non-flash)
Nov 07 04:10:55 user nova-compute[74540]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f (non-flash)
Nov 07 04:10:55 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:10:55 user nova-compute[74540]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5bdc575-6e3b-4a1d-8617-efa33ce8ec16 (non-flash)
Nov 07 04:10:55 user nova-compute[74540]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f (non-flash)
Nov 07 04:10:55 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a9d55a-64de-4376-84b6-44bc29426dd0]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:10:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCJXaINS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:10:56 user nova-compute[74540]: INFO nova.compute.claims [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Claim successful on node user
Nov 07 04:10:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26436636331383437', 'path': '/dev/sdd'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436636331383437', 'path': '/dev/sdd'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.objects.instance [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'flavor' on Instance uuid 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:10:56 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:10:56 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:10:56 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:10:56 user nova-compute[74540]:   <serial>9f881037-2e11-4acd-aea6-0432598f6e0f</serial>
Nov 07 04:10:56 user nova-compute[74540]: </disk>
Nov 07 04:10:56 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:10:56 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] No VIF found with MAC fa:16:3e:f7:9f:73, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:10:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:10:57 user nova-compute[74540]: DEBUG nova.policy [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99ba0f9acca84cdb8cf90c4b313e1b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438cd05cbdb34608940422562ba150c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:10:57 user nova-compute[74540]: INFO nova.virt.block_device [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Booting with blank volume at /dev/vda
Nov 07 04:10:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1ba71139-a51e-4dd1-a50b-0c58dbea242b tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.348s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:10:57 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Successfully created port: d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:10:58 user nova-compute[74540]: INFO nova.compute.manager [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Detaching volume 9f881037-2e11-4acd-aea6-0432598f6e0f
Nov 07 04:10:58 user nova-compute[74540]: INFO nova.virt.block_device [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Attempting to driver detach volume 9f881037-2e11-4acd-aea6-0432598f6e0f from mountpoint /dev/vdb
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Attempting to detach device vdb from instance 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:10:58 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:10:58 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:10:58 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:10:58 user nova-compute[74540]:   <serial>9f881037-2e11-4acd-aea6-0432598f6e0f</serial>
Nov 07 04:10:58 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:10:58 user nova-compute[74540]: </disk>
Nov 07 04:10:58 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:10:58 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully detached device vdb from instance 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 from the persistent domain config.
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:10:58 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:10:58 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:10:58 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:10:58 user nova-compute[74540]:   <serial>9f881037-2e11-4acd-aea6-0432598f6e0f</serial>
Nov 07 04:10:58 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:10:58 user nova-compute[74540]: </disk>
Nov 07 04:10:58 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Successfully updated port: d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquired lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-8f5208b2-1fd7-46e4-8466-4ec679cfb06d req-51fc7ec6-3eda-4a5c-b2e5-f6a1e229f341 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-changed-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-8f5208b2-1fd7-46e4-8466-4ec679cfb06d req-51fc7ec6-3eda-4a5c-b2e5-f6a1e229f341 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Refreshing instance network info cache due to event network-changed-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8f5208b2-1fd7-46e4-8466-4ec679cfb06d req-51fc7ec6-3eda-4a5c-b2e5-f6a1e229f341 service nova] Acquiring lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Updating instance_info_cache with network_info: [{"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Releasing lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Instance network_info: |[{"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8f5208b2-1fd7-46e4-8466-4ec679cfb06d req-51fc7ec6-3eda-4a5c-b2e5-f6a1e229f341 service nova] Acquired lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.network.neutron [req-8f5208b2-1fd7-46e4-8466-4ec679cfb06d req-51fc7ec6-3eda-4a5c-b2e5-f6a1e229f341 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Refreshing network info cache for port d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:10:59 user nova-compute[74540]: DEBUG nova.network.neutron [req-8f5208b2-1fd7-46e4-8466-4ec679cfb06d req-51fc7ec6-3eda-4a5c-b2e5-f6a1e229f341 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Updated VIF entry in instance network info cache for port d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:10:59 user nova-compute[74540]: DEBUG nova.network.neutron [req-8f5208b2-1fd7-46e4-8466-4ec679cfb06d req-51fc7ec6-3eda-4a5c-b2e5-f6a1e229f341 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Updating instance_info_cache with network_info: [{"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:10:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8f5208b2-1fd7-46e4-8466-4ec679cfb06d req-51fc7ec6-3eda-4a5c-b2e5-f6a1e229f341 service nova] Releasing lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:11:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:02 user nova-compute[74540]: DEBUG os_brick.utils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:11:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[94005431-b1f8-4a7d-9071-95125fe06738]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[562ae728-e06a-42db-b6d0-4091a19ffa9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88ca361-c5a3-4ec9-9d7b-fa4720ac500e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1665e0-7f4a-42eb-964a-b4c594e3ad66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:11:03 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:11:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae10913c-4623-4e35-9e49-b7175574b917]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG os_brick.utils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Updating existing volume attachment record: dbf242e7-9c6f-458b-a8d4-852357850929 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:11:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:11:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:07 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:11:07 user nova-compute[74540]: INFO nova.compute.claims [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Claim successful on node user
Nov 07 04:11:08 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:11:08 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:11:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG nova.policy [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47fad238078941dba4cc57406b1c69ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796865203135404b8624363d533ae6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:11:08 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Creating image(s)
Nov 07 04:11:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "/opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "/opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.203s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.220s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk 1073741824" returned: 0 in 0.062s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.238s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Successfully created port: f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Cannot resize image /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Ensure instance console log exists: /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Successfully updated port: f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquired lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.compute.manager [req-b40fc9f5-98c6-4760-a102-56df8bacec34 req-90257fb2-89ec-4550-84c3-a86b3cf09014 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-changed-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.compute.manager [req-b40fc9f5-98c6-4760-a102-56df8bacec34 req-90257fb2-89ec-4550-84c3-a86b3cf09014 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Refreshing instance network info cache due to event network-changed-f06d373b-0587-4432-9c3b-8da8b7a99dac. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b40fc9f5-98c6-4760-a102-56df8bacec34 req-90257fb2-89ec-4550-84c3-a86b3cf09014 service nova] Acquiring lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.network.neutron [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updating instance_info_cache with network_info: [{"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Releasing lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Instance network_info: |[{"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b40fc9f5-98c6-4760-a102-56df8bacec34 req-90257fb2-89ec-4550-84c3-a86b3cf09014 service nova] Acquired lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.network.neutron [req-b40fc9f5-98c6-4760-a102-56df8bacec34 req-90257fb2-89ec-4550-84c3-a86b3cf09014 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Refreshing network info cache for port f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Start _get_guest_xml network_info=[{"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:11:10 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:11:10 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746250716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746250716',id=28,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNChMQCLEy9+WuUP39ksN9q/qa3TqLb45LKZcHylN1OOkc1rkBz3INROxl/WpAAfTfI2AGIrUFbN9SI7GkWRLRakALvOyCI3Nz/jruNUIhLg9I+QxWS7piL60Vr0FmneGg==',key_name='tempest-keypair-24688172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='796865203135404b8624363d533ae6fe',ramdisk_id='',reservation_id='r-oora9sqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-952443794',owner_user_name='tempest-AttachVolumeShelveTestJSON-952443794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fad238078941dba4cc57406b1c69ed',uuid=dc24a0b7-ff3c-482c-b0c5-0dcd70dda367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converting VIF {"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.objects.instance [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'pci_devices' on Instance uuid dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:11:10 user nova-compute[74540]:   <uuid>dc24a0b7-ff3c-482c-b0c5-0dcd70dda367</uuid>
Nov 07 04:11:10 user nova-compute[74540]:   <name>instance-0000001c</name>
Nov 07 04:11:10 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:11:10 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:11:10 user nova-compute[74540]:   <metadata>
Nov 07 04:11:10 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:11:10 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:11:10 user nova-compute[74540]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1746250716</nova:name>
Nov 07 04:11:10 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:11:10</nova:creationTime>
Nov 07 04:11:10 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:11:10 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:11:10 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:11:10 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:11:10 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:11:10 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:11:10 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:11:10 user nova-compute[74540]:       <nova:owner>
Nov 07 04:11:10 user nova-compute[74540]:         <nova:user uuid="47fad238078941dba4cc57406b1c69ed">tempest-AttachVolumeShelveTestJSON-952443794-project-member</nova:user>
Nov 07 04:11:10 user nova-compute[74540]:         <nova:project uuid="796865203135404b8624363d533ae6fe">tempest-AttachVolumeShelveTestJSON-952443794</nova:project>
Nov 07 04:11:10 user nova-compute[74540]:       </nova:owner>
Nov 07 04:11:10 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:11:10 user nova-compute[74540]:       <nova:ports>
Nov 07 04:11:10 user nova-compute[74540]:         <nova:port uuid="f06d373b-0587-4432-9c3b-8da8b7a99dac">
Nov 07 04:11:10 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 07 04:11:10 user nova-compute[74540]:         </nova:port>
Nov 07 04:11:10 user nova-compute[74540]:       </nova:ports>
Nov 07 04:11:10 user nova-compute[74540]:     </nova:instance>
Nov 07 04:11:10 user nova-compute[74540]:   </metadata>
Nov 07 04:11:10 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:11:10 user nova-compute[74540]:     <system>
Nov 07 04:11:10 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:11:10 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:11:10 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:11:10 user nova-compute[74540]:       <entry name="serial">dc24a0b7-ff3c-482c-b0c5-0dcd70dda367</entry>
Nov 07 04:11:10 user nova-compute[74540]:       <entry name="uuid">dc24a0b7-ff3c-482c-b0c5-0dcd70dda367</entry>
Nov 07 04:11:10 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:11:10 user nova-compute[74540]:     </system>
Nov 07 04:11:10 user nova-compute[74540]:   </sysinfo>
Nov 07 04:11:10 user nova-compute[74540]:   <os>
Nov 07 04:11:10 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:11:10 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:11:10 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:11:10 user nova-compute[74540]:   </os>
Nov 07 04:11:10 user nova-compute[74540]:   <features>
Nov 07 04:11:10 user nova-compute[74540]:     <acpi/>
Nov 07 04:11:10 user nova-compute[74540]:     <apic/>
Nov 07 04:11:10 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:11:10 user nova-compute[74540]:   </features>
Nov 07 04:11:10 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:11:10 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:11:10 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:11:10 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:11:10 user nova-compute[74540]:   </clock>
Nov 07 04:11:10 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:11:10 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:11:10 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:11:10 user nova-compute[74540]:   </cpu>
Nov 07 04:11:10 user nova-compute[74540]:   <devices>
Nov 07 04:11:10 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:11:10 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:11:10 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk"/>
Nov 07 04:11:10 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:11:10 user nova-compute[74540]:     </disk>
Nov 07 04:11:10 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:11:10 user nova-compute[74540]:       <mac address="fa:16:3e:7e:23:61"/>
Nov 07 04:11:10 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:11:10 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:11:10 user nova-compute[74540]:       <target dev="tapf06d373b-05"/>
Nov 07 04:11:10 user nova-compute[74540]:     </interface>
Nov 07 04:11:10 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:11:10 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/console.log" append="off"/>
Nov 07 04:11:10 user nova-compute[74540]:     </serial>
Nov 07 04:11:10 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:11:10 user nova-compute[74540]:     <video>
Nov 07 04:11:10 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:11:10 user nova-compute[74540]:     </video>
Nov 07 04:11:10 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:11:10 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:11:10 user nova-compute[74540]:     </rng>
Nov 07 04:11:10 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:11:10 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:11:10 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:11:10 user nova-compute[74540]:     </memballoon>
Nov 07 04:11:10 user nova-compute[74540]:   </devices>
Nov 07 04:11:10 user nova-compute[74540]: </domain>
Nov 07 04:11:10 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746250716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746250716',id=28,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNChMQCLEy9+WuUP39ksN9q/qa3TqLb45LKZcHylN1OOkc1rkBz3INROxl/WpAAfTfI2AGIrUFbN9SI7GkWRLRakALvOyCI3Nz/jruNUIhLg9I+QxWS7piL60Vr0FmneGg==',key_name='tempest-keypair-24688172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='796865203135404b8624363d533ae6fe',ramdisk_id='',reservation_id='r-oora9sqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-952443794',owner_user_name='tempest-AttachVolumeShelveTestJSON-952443794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fad238078941dba4cc57406b1c69ed',uuid=dc24a0b7-ff3c-482c-b0c5-0dcd70dda367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converting VIF {"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG os_vif [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af54b29e-7839-56c0-a182-214ad139f561', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf06d373b-05, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf06d373b-05, col_values=(('qos', UUID('6995eae2-01c8-41ac-b88c-f9b64f776510')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf06d373b-05, col_values=(('external_ids', {'iface-id': 'f06d373b-0587-4432-9c3b-8da8b7a99dac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:23:61', 'vm-uuid': 'dc24a0b7-ff3c-482c-b0c5-0dcd70dda367'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:10 user nova-compute[74540]: INFO os_vif [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05')
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:11:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] No VIF found with MAC fa:16:3e:7e:23:61, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:11:11 user nova-compute[74540]: DEBUG nova.network.neutron [req-b40fc9f5-98c6-4760-a102-56df8bacec34 req-90257fb2-89ec-4550-84c3-a86b3cf09014 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updated VIF entry in instance network info cache for port f06d373b-0587-4432-9c3b-8da8b7a99dac. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:11:11 user nova-compute[74540]: DEBUG nova.network.neutron [req-b40fc9f5-98c6-4760-a102-56df8bacec34 req-90257fb2-89ec-4550-84c3-a86b3cf09014 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updating instance_info_cache with network_info: [{"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:11:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b40fc9f5-98c6-4760-a102-56df8bacec34 req-90257fb2-89ec-4550-84c3-a86b3cf09014 service nova] Releasing lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:11:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-60d546b8-ddc2-4474-b206-3de6fbde0db3 req-ae7648ea-2743-48be-8a15-b36d1b71574e service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-60d546b8-ddc2-4474-b206-3de6fbde0db3 req-ae7648ea-2743-48be-8a15-b36d1b71574e service nova] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-60d546b8-ddc2-4474-b206-3de6fbde0db3 req-ae7648ea-2743-48be-8a15-b36d1b71574e service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-60d546b8-ddc2-4474-b206-3de6fbde0db3 req-ae7648ea-2743-48be-8a15-b36d1b71574e service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-60d546b8-ddc2-4474-b206-3de6fbde0db3 req-ae7648ea-2743-48be-8a15-b36d1b71574e service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] No waiting events found dispatching network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:11:12 user nova-compute[74540]: WARNING nova.compute.manager [req-60d546b8-ddc2-4474-b206-3de6fbde0db3 req-ae7648ea-2743-48be-8a15-b36d1b71574e service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received unexpected event network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac for instance with vm_state building and task_state spawning.
Nov 07 04:11:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:14 user nova-compute[74540]: DEBUG nova.compute.manager [req-63fd1d9e-413d-4f6f-9da7-a54b34c471a9 req-ea4c13be-958d-4979-874f-6a3ed1a60ccf service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-63fd1d9e-413d-4f6f-9da7-a54b34c471a9 req-ea4c13be-958d-4979-874f-6a3ed1a60ccf service nova] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-63fd1d9e-413d-4f6f-9da7-a54b34c471a9 req-ea4c13be-958d-4979-874f-6a3ed1a60ccf service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-63fd1d9e-413d-4f6f-9da7-a54b34c471a9 req-ea4c13be-958d-4979-874f-6a3ed1a60ccf service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:14 user nova-compute[74540]: DEBUG nova.compute.manager [req-63fd1d9e-413d-4f6f-9da7-a54b34c471a9 req-ea4c13be-958d-4979-874f-6a3ed1a60ccf service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] No waiting events found dispatching network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:11:14 user nova-compute[74540]: WARNING nova.compute.manager [req-63fd1d9e-413d-4f6f-9da7-a54b34c471a9 req-ea4c13be-958d-4979-874f-6a3ed1a60ccf service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received unexpected event network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac for instance with vm_state building and task_state spawning.
Nov 07 04:11:14 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:11:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:11:14 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Instance spawned successfully.
Nov 07 04:11:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:11:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:11:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:11:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:11:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:11:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:11:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:11:14 user nova-compute[74540]: INFO nova.compute.manager [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 07 04:11:14 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:11:14 user nova-compute[74540]: INFO nova.compute.manager [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Took 6.96 seconds to build instance.
Nov 07 04:11:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bacfd33b-f5bb-472c-aa65-9db3e31ea126 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.055s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-908616aa-ed28-4bdb-bc45-95caa1c1e5aa req-95ef4b22-68d0-4120-9e5c-f77bcd3b02f8 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-changed-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-908616aa-ed28-4bdb-bc45-95caa1c1e5aa req-95ef4b22-68d0-4120-9e5c-f77bcd3b02f8 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Refreshing instance network info cache due to event network-changed-82decd3b-b1ba-4b4c-88ab-fbae31e34394. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-908616aa-ed28-4bdb-bc45-95caa1c1e5aa req-95ef4b22-68d0-4120-9e5c-f77bcd3b02f8 service nova] Acquiring lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-908616aa-ed28-4bdb-bc45-95caa1c1e5aa req-95ef4b22-68d0-4120-9e5c-f77bcd3b02f8 service nova] Acquired lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-908616aa-ed28-4bdb-bc45-95caa1c1e5aa req-95ef4b22-68d0-4120-9e5c-f77bcd3b02f8 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Refreshing network info cache for port 82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:11:18 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 is timed out.
Nov 07 04:11:18 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully detached device vdb from instance 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 from the live domain config.
Nov 07 04:11:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oCJXaINS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:11:18 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9254ca05-4e11-44a3-9323-6f97c23904ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:11:18 user nova-compute[74540]: No targets found.
Nov 07 04:11:18 user nova-compute[74540]: iSNS:
Nov 07 04:11:18 user nova-compute[74540]: No targets found.
Nov 07 04:11:18 user nova-compute[74540]: STATIC:
Nov 07 04:11:18 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a
Nov 07 04:11:18 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:11:18 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:11:18 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f
Nov 07 04:11:18 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:11:18 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:11:18 user nova-compute[74540]: FIRMWARE:
Nov 07 04:11:18 user nova-compute[74540]: No targets found.
Nov 07 04:11:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:11:18 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:11:18 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[867398e4-7ac9-4b91-bb98-07f732a048c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:18 user nova-compute[74540]: INFO nova.compute.manager [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Detaching volume 485b0b7f-affb-4576-beb6-807efcbe5c0a
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0beb07e-2b32-457f-886d-45540c8ae879]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:11:18 user nova-compute[74540]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f (non-flash)
Nov 07 04:11:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:11:18 user nova-compute[74540]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f (non-flash)
Nov 07 04:11:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc14ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f'): ({'sdd'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Removing single pathed devices sdd {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc341a66-e3b5-4ae4-9724-c81136d48157]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-908616aa-ed28-4bdb-bc45-95caa1c1e5aa req-95ef4b22-68d0-4120-9e5c-f77bcd3b02f8 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updated VIF entry in instance network info cache for port 82decd3b-b1ba-4b4c-88ab-fbae31e34394. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-908616aa-ed28-4bdb-bc45-95caa1c1e5aa req-95ef4b22-68d0-4120-9e5c-f77bcd3b02f8 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updating instance_info_cache with network_info: [{"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae322add-4b46-422a-8fff-2da3f982e86c]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Flushing IO for device /dev/sdd {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-908616aa-ed28-4bdb-bc45-95caa1c1e5aa req-95ef4b22-68d0-4120-9e5c-f77bcd3b02f8 service nova] Releasing lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be5eced-2d49-45ee-b379-863cd3876363]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:18 user nova-compute[74540]: INFO nova.virt.block_device [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Attempting to driver detach volume 485b0b7f-affb-4576-beb6-807efcbe5c0a from mountpoint /dev/vdb
Nov 07 04:11:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Attempting to detach device vdb from instance d61ec49c-3345-4808-bfcd-a9d925fe1918 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:11:18 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:11:18 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:11:18 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:11:18 user nova-compute[74540]:   <serial>485b0b7f-affb-4576-beb6-807efcbe5c0a</serial>
Nov 07 04:11:18 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:11:18 user nova-compute[74540]: </disk>
Nov 07 04:11:18 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:11:18 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Successfully detached device vdb from instance d61ec49c-3345-4808-bfcd-a9d925fe1918 from the persistent domain config.
Nov 07 04:11:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d61ec49c-3345-4808-bfcd-a9d925fe1918 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:11:18 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:11:18 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:11:18 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:11:18 user nova-compute[74540]:   <serial>485b0b7f-affb-4576-beb6-807efcbe5c0a</serial>
Nov 07 04:11:18 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:11:18 user nova-compute[74540]: </disk>
Nov 07 04:11:18 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[393dcf21-ab81-4bb6-b237-7f58a80a4580]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7233d982-cc2a-48df-a059-aa257531a42e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec1de6c-f734-428b-9e85-394177ec1069]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f, portal: 172.16.0.220,3260]
Nov 07 04:11:18 user nova-compute[74540]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f, portal: 172.16.0.220,3260] successful.
Nov 07 04:11:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f881037-2e11-4acd-aea6-0432598f6e0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[182b0517-3bf4-4b64-9b2d-92a19482fb9c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] <== disconnect_volume: return (332ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:11:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:11:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:11:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:19 user nova-compute[74540]: INFO nova.compute.manager [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Terminating instance
Nov 07 04:11:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:11:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG nova.objects.instance [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'flavor' on Instance uuid 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-33244227-3f89-473e-b11d-f1128721ad31 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.200s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG nova.compute.manager [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-changed-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG nova.compute.manager [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Refreshing instance network info cache due to event network-changed-82decd3b-b1ba-4b4c-88ab-fbae31e34394. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] Acquiring lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] Acquired lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Refreshing network info cache for port 82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:11:20 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Instance destroyed successfully.
Nov 07 04:11:20 user nova-compute[74540]: DEBUG nova.objects.instance [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lazy-loading 'resources' on Instance uuid 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T04:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-905638517',display_name='tempest-ServerActionsTestOtherA-server-612150756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-905638517',id=21,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnVI6gwzel5Ql/BuaLSS3BsMPir/RBkcVGKmw5hj9mqhnJPLS6fivjrEUdxmnvOsXyWSIwfONC16BOCTgU/hkRjILu4a9Q61a1FizttTQVjvxUM6qM6uvcsjWMI5HVtcA==',key_name='tempest-keypair-1497340994',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:08:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-hs9y32ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:08:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=74271ad1-5dc8-4f92-83cf-4f31d05b0dd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "address": "fa:16:3e:21:1b:68", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32b18c39-92", "ovs_interfaceid": "32b18c39-92d0-488b-891e-fd7b5f9b85d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG os_vif [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32b18c39-92, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=308db024-3609-42e2-9714-a75d6e1ff056) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:20 user nova-compute[74540]: INFO os_vif [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:68,bridge_name='br-int',has_traffic_filtering=True,id=32b18c39-92d0-488b-891e-fd7b5f9b85d1,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32b18c39-92')
Nov 07 04:11:20 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Deleting instance files /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6_del
Nov 07 04:11:20 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Deletion of /opt/stack/data/nova/instances/74271ad1-5dc8-4f92-83cf-4f31d05b0dd6_del complete
Nov 07 04:11:20 user nova-compute[74540]: INFO nova.compute.manager [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 07 04:11:20 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:11:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG nova.network.neutron [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updated VIF entry in instance network info cache for port 82decd3b-b1ba-4b4c-88ab-fbae31e34394. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG nova.network.neutron [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updating instance_info_cache with network_info: [{"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] Releasing lock "refresh_cache-d61ec49c-3345-4808-bfcd-a9d925fe1918" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received event network-vif-unplugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] No waiting events found dispatching network-vif-unplugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received event network-vif-unplugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received event network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] Acquiring lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] No waiting events found dispatching network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:11:21 user nova-compute[74540]: WARNING nova.compute.manager [req-a83b7dcb-9444-4179-b696-fa04dd3dd889 req-0aa7aa62-b46f-45ec-b906-57f2b3839ab8 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received unexpected event network-vif-plugged-32b18c39-92d0-488b-891e-fd7b5f9b85d1 for instance with vm_state active and task_state deleting.
Nov 07 04:11:21 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:11:21 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Took 0.84 seconds to deallocate network for instance.
Nov 07 04:11:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:11:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:21 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Deleted allocations for instance 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6
Nov 07 04:11:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-1520db26-6bbc-4d5a-8469-0525a8e6ec3c tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "74271ad1-5dc8-4f92-83cf-4f31d05b0dd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.483s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-23228f2e-2110-4824-b118-afe2267af88d req-0134bae5-9c45-47c9-be29-760459090a39 service nova] [instance: 74271ad1-5dc8-4f92-83cf-4f31d05b0dd6] Received event network-vif-deleted-32b18c39-92d0-488b-891e-fd7b5f9b85d1 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:11:32 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Creating image(s)
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Ensure instance console log exists: /opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Start _get_guest_xml network_info=[{"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVHNEMTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ac4742cd-822a-43b1-adc7-4c7452bd0e35', 'attached_at': '', 'detached_at': '', 'volume_id': '35a7a6dd-6cc6-4528-b0fd-172e6a6b5527', 'serial': '35a7a6dd-6cc6-4528-b0fd-172e6a6b5527'}, 'boot_index': 0, 'attachment_id': 'dbf242e7-9c6f-458b-a8d4-852357850929', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:11:32 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:11:32 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVHNEMTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:11:32 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:11:32 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:11:32 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[060f6531-2455-4b59-8e42-b31100990add]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:11:32 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d276a6-6034-4bc7-b842-bf6d5a7400bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527] added
Nov 07 04:11:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1167f0-032c-4f1b-800b-59534bb2451e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[312ac9f9-99f4-4556-aab1-193537ea6223]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVHNEMTU {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVHNEMTU" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7944c96a-7bcd-4f51-9d8f-8a8f00640fdf]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sVHNEMTU'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[790d6346-3922-404c-92b2-0a56f289d033]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1500ca98-6d4b-4a0c-bb3a-e20db1d9d347]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:11:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:11:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8fef75-9aba-419c-af7b-2dffa9191bd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527, portal: 172.16.0.220,3260]
Nov 07 04:11:32 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527, portal: 172.16.0.220,3260] successful.
Nov 07 04:11:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b44a5e-413e-4cef-a81b-165c4ca922fb]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bd3ab7-6218-4c01-9ae9-3b6c92333f2b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:11:33 user nova-compute[74540]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:11:33 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:11:33 user nova-compute[74540]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:11:33 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[aada540f-8fa6-4259-8999-dc4f33b37ed5]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:11:33 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVHNEMTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23336643137303431', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336643137303431', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-183391627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-183391627',id=27,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-yoku2v0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:10:57Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=ac4742cd-822a-43b1-adc7-4c7452bd0e35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:58:23,bridge_name='br-int',has_traffic_filtering=True,id=d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cbc02f-e0') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG nova.objects.instance [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'pci_devices' on Instance uuid ac4742cd-822a-43b1-adc7-4c7452bd0e35 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:11:34 user nova-compute[74540]:   <uuid>ac4742cd-822a-43b1-adc7-4c7452bd0e35</uuid>
Nov 07 04:11:34 user nova-compute[74540]:   <name>instance-0000001b</name>
Nov 07 04:11:34 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:11:34 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:11:34 user nova-compute[74540]:   <metadata>
Nov 07 04:11:34 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:11:34 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:11:34 user nova-compute[74540]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-183391627</nova:name>
Nov 07 04:11:34 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:11:32</nova:creationTime>
Nov 07 04:11:34 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:11:34 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:11:34 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:11:34 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:11:34 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:11:34 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:11:34 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:11:34 user nova-compute[74540]:       <nova:owner>
Nov 07 04:11:34 user nova-compute[74540]:         <nova:user uuid="99ba0f9acca84cdb8cf90c4b313e1b7c">tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member</nova:user>
Nov 07 04:11:34 user nova-compute[74540]:         <nova:project uuid="438cd05cbdb34608940422562ba150c8">tempest-ServerBootFromVolumeStableRescueTest-1329597446</nova:project>
Nov 07 04:11:34 user nova-compute[74540]:       </nova:owner>
Nov 07 04:11:34 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:11:34 user nova-compute[74540]:       <nova:ports>
Nov 07 04:11:34 user nova-compute[74540]:         <nova:port uuid="d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22">
Nov 07 04:11:34 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 04:11:34 user nova-compute[74540]:         </nova:port>
Nov 07 04:11:34 user nova-compute[74540]:       </nova:ports>
Nov 07 04:11:34 user nova-compute[74540]:     </nova:instance>
Nov 07 04:11:34 user nova-compute[74540]:   </metadata>
Nov 07 04:11:34 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:11:34 user nova-compute[74540]:     <system>
Nov 07 04:11:34 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:11:34 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:11:34 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:11:34 user nova-compute[74540]:       <entry name="serial">ac4742cd-822a-43b1-adc7-4c7452bd0e35</entry>
Nov 07 04:11:34 user nova-compute[74540]:       <entry name="uuid">ac4742cd-822a-43b1-adc7-4c7452bd0e35</entry>
Nov 07 04:11:34 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:11:34 user nova-compute[74540]:     </system>
Nov 07 04:11:34 user nova-compute[74540]:   </sysinfo>
Nov 07 04:11:34 user nova-compute[74540]:   <os>
Nov 07 04:11:34 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:11:34 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:11:34 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:11:34 user nova-compute[74540]:   </os>
Nov 07 04:11:34 user nova-compute[74540]:   <features>
Nov 07 04:11:34 user nova-compute[74540]:     <acpi/>
Nov 07 04:11:34 user nova-compute[74540]:     <apic/>
Nov 07 04:11:34 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:11:34 user nova-compute[74540]:   </features>
Nov 07 04:11:34 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:11:34 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:11:34 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:11:34 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:11:34 user nova-compute[74540]:   </clock>
Nov 07 04:11:34 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:11:34 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:11:34 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:11:34 user nova-compute[74540]:   </cpu>
Nov 07 04:11:34 user nova-compute[74540]:   <devices>
Nov 07 04:11:34 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:11:34 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:11:34 user nova-compute[74540]:       <source dev="/dev/sdb"/>
Nov 07 04:11:34 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:11:34 user nova-compute[74540]:       <serial>35a7a6dd-6cc6-4528-b0fd-172e6a6b5527</serial>
Nov 07 04:11:34 user nova-compute[74540]:     </disk>
Nov 07 04:11:34 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:11:34 user nova-compute[74540]:       <mac address="fa:16:3e:0e:58:23"/>
Nov 07 04:11:34 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:11:34 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:11:34 user nova-compute[74540]:       <target dev="tapd0cbc02f-e0"/>
Nov 07 04:11:34 user nova-compute[74540]:     </interface>
Nov 07 04:11:34 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:11:34 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/console.log" append="off"/>
Nov 07 04:11:34 user nova-compute[74540]:     </serial>
Nov 07 04:11:34 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:11:34 user nova-compute[74540]:     <video>
Nov 07 04:11:34 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:11:34 user nova-compute[74540]:     </video>
Nov 07 04:11:34 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:11:34 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:11:34 user nova-compute[74540]:     </rng>
Nov 07 04:11:34 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:11:34 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:11:34 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:11:34 user nova-compute[74540]:     </memballoon>
Nov 07 04:11:34 user nova-compute[74540]:   </devices>
Nov 07 04:11:34 user nova-compute[74540]: </domain>
Nov 07 04:11:34 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-183391627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-183391627',id=27,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-yoku2v0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:10:57Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=ac4742cd-822a-43b1-adc7-4c7452bd0e35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:58:23,bridge_name='br-int',has_traffic_filtering=True,id=d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cbc02f-e0') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG os_vif [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:58:23,bridge_name='br-int',has_traffic_filtering=True,id=d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cbc02f-e0') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f320b99-dd1b-57a8-9876-5e1d79f5cd94', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0cbc02f-e0, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0cbc02f-e0, col_values=(('qos', UUID('1a1553df-eb84-447d-a218-fab5c56b1520')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0cbc02f-e0, col_values=(('external_ids', {'iface-id': 'd0cbc02f-e0a3-4fb9-a34e-96cc6898ef22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:58:23', 'vm-uuid': 'ac4742cd-822a-43b1-adc7-4c7452bd0e35'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:34 user nova-compute[74540]: INFO os_vif [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:58:23,bridge_name='br-int',has_traffic_filtering=True,id=d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cbc02f-e0')
Nov 07 04:11:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:11:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No VIF found with MAC fa:16:3e:0e:58:23, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:11:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:35 user nova-compute[74540]: DEBUG nova.compute.manager [req-7e970640-92c9-4c98-ad4d-05e22019d0e2 req-c2f5f794-5840-4246-a7a7-078c8b68d78b service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7e970640-92c9-4c98-ad4d-05e22019d0e2 req-c2f5f794-5840-4246-a7a7-078c8b68d78b service nova] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7e970640-92c9-4c98-ad4d-05e22019d0e2 req-c2f5f794-5840-4246-a7a7-078c8b68d78b service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7e970640-92c9-4c98-ad4d-05e22019d0e2 req-c2f5f794-5840-4246-a7a7-078c8b68d78b service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:35 user nova-compute[74540]: DEBUG nova.compute.manager [req-7e970640-92c9-4c98-ad4d-05e22019d0e2 req-c2f5f794-5840-4246-a7a7-078c8b68d78b service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] No waiting events found dispatching network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:11:35 user nova-compute[74540]: WARNING nova.compute.manager [req-7e970640-92c9-4c98-ad4d-05e22019d0e2 req-c2f5f794-5840-4246-a7a7-078c8b68d78b service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received unexpected event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 for instance with vm_state building and task_state spawning.
Nov 07 04:11:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:36 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:11:37 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Instance spawned successfully.
Nov 07 04:11:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:11:37 user nova-compute[74540]: INFO nova.compute.manager [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 07 04:11:37 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-c9737180-e8bf-40ef-9957-e80144e20a9d req-38040c65-d974-4347-89f5-9a214ea65e40 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c9737180-e8bf-40ef-9957-e80144e20a9d req-38040c65-d974-4347-89f5-9a214ea65e40 service nova] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c9737180-e8bf-40ef-9957-e80144e20a9d req-38040c65-d974-4347-89f5-9a214ea65e40 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c9737180-e8bf-40ef-9957-e80144e20a9d req-38040c65-d974-4347-89f5-9a214ea65e40 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-c9737180-e8bf-40ef-9957-e80144e20a9d req-38040c65-d974-4347-89f5-9a214ea65e40 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] No waiting events found dispatching network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:11:37 user nova-compute[74540]: WARNING nova.compute.manager [req-c9737180-e8bf-40ef-9957-e80144e20a9d req-38040c65-d974-4347-89f5-9a214ea65e40 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received unexpected event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 for instance with vm_state building and task_state spawning.
Nov 07 04:11:38 user nova-compute[74540]: INFO nova.compute.manager [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Took 41.67 seconds to build instance.
Nov 07 04:11:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8ed82b6d-6aea-4af4-bfb9-fb2d87172134 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.815s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:38 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:11:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "d8608e1a-77c6-4156-812b-e73012d0b2d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:38 user nova-compute[74540]: INFO nova.compute.manager [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Terminating instance
Nov 07 04:11:38 user nova-compute[74540]: DEBUG nova.compute.manager [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:11:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:39 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d61ec49c-3345-4808-bfcd-a9d925fe1918 is timed out.
Nov 07 04:11:39 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Successfully detached device vdb from instance d61ec49c-3345-4808-bfcd-a9d925fe1918 from the live domain config.
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxYcmgNq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:11:39 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e2810a-5fc1-4371-bc96-4a238738a158]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:11:39 user nova-compute[74540]: No targets found.
Nov 07 04:11:39 user nova-compute[74540]: iSNS:
Nov 07 04:11:39 user nova-compute[74540]: No targets found.
Nov 07 04:11:39 user nova-compute[74540]: STATIC:
Nov 07 04:11:39 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a
Nov 07 04:11:39 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:11:39 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:11:39 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:11:39 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:11:39 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:11:39 user nova-compute[74540]: FIRMWARE:
Nov 07 04:11:39 user nova-compute[74540]: No targets found.
Nov 07 04:11:39 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:11:39 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:11:39 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[50521d8a-5a30-4ab8-85b1-2675a3cb2bb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6a6469-f3b9-480a-9eb8-97e35519cdb9]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:11:39 user nova-compute[74540]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:11:39 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a (non-flash)
Nov 07 04:11:39 user nova-compute[74540]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:11:39 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee14290a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f4443b-871d-4b4f-b1b8-f6b0323b3160]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[769ed867-5538-401a-b03c-d1f48c33249f]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb573496-91a5-4f38-9b84-fc92617a3de8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:39 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Instance destroyed successfully.
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.objects.instance [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lazy-loading 'resources' on Instance uuid d8608e1a-77c6-4156-812b-e73012d0b2d4 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:09:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1181306841',display_name='tempest-VolumesActionsTest-instance-1181306841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1181306841',id=25,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:09:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b13ca54283e24792a14346398c50e8c9',ramdisk_id='',reservation_id='r-ap2z850m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1216468883',owner_user_name='tempest-VolumesActionsTest-1216468883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:09:55Z,user_data=None,user_id='19215be651f54d5aa160548205a6dc93',uuid=d8608e1a-77c6-4156-812b-e73012d0b2d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "address": "fa:16:3e:23:1a:f4", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53cd24-2f", "ovs_interfaceid": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Converting VIF {"id": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "address": "fa:16:3e:23:1a:f4", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c53cd24-2f", "ovs_interfaceid": "3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:f4,bridge_name='br-int',has_traffic_filtering=True,id=3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c53cd24-2f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_vif [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:f4,bridge_name='br-int',has_traffic_filtering=True,id=3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c53cd24-2f') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d75a061-16ab-41f7-8839-d8ce4d5222fd]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c53cd24-2f, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b0257a5-bdb4-4eb5-958d-2d5bf3aa3bf2) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[354439ad-f15d-4bab-8539-a596c63f8870]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:39 user nova-compute[74540]: INFO os_vif [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:1a:f4,bridge_name='br-int',has_traffic_filtering=True,id=3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c53cd24-2f')
Nov 07 04:11:39 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Deleting instance files /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4_del
Nov 07 04:11:39 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Deletion of /opt/stack/data/nova/instances/d8608e1a-77c6-4156-812b-e73012d0b2d4_del complete
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c88139-259a-46a7-84d1-75b7f3924d54]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a, portal: 172.16.0.220,3260]
Nov 07 04:11:39 user nova-compute[74540]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a, portal: 172.16.0.220,3260] successful.
Nov 07 04:11:39 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:39 user nova-compute[74540]: INFO nova.compute.manager [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:485b0b7f-affb-4576-beb6-807efcbe5c0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[da128bc2-9cae-4471-bdc3-5a147afba82c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] <== disconnect_volume: return (326ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-0decb5c5-24d2-470a-b02f-f8863976e97e req-2b499fd7-cbdd-4745-8a9f-3558c5bb1d42 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Received event network-vif-unplugged-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0decb5c5-24d2-470a-b02f-f8863976e97e req-2b499fd7-cbdd-4745-8a9f-3558c5bb1d42 service nova] Acquiring lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0decb5c5-24d2-470a-b02f-f8863976e97e req-2b499fd7-cbdd-4745-8a9f-3558c5bb1d42 service nova] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0decb5c5-24d2-470a-b02f-f8863976e97e req-2b499fd7-cbdd-4745-8a9f-3558c5bb1d42 service nova] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-0decb5c5-24d2-470a-b02f-f8863976e97e req-2b499fd7-cbdd-4745-8a9f-3558c5bb1d42 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] No waiting events found dispatching network-vif-unplugged-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-0decb5c5-24d2-470a-b02f-f8863976e97e req-2b499fd7-cbdd-4745-8a9f-3558c5bb1d42 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Received event network-vif-unplugged-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-0decb5c5-24d2-470a-b02f-f8863976e97e req-2b499fd7-cbdd-4745-8a9f-3558c5bb1d42 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Received event network-vif-plugged-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0decb5c5-24d2-470a-b02f-f8863976e97e req-2b499fd7-cbdd-4745-8a9f-3558c5bb1d42 service nova] Acquiring lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0decb5c5-24d2-470a-b02f-f8863976e97e req-2b499fd7-cbdd-4745-8a9f-3558c5bb1d42 service nova] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0decb5c5-24d2-470a-b02f-f8863976e97e req-2b499fd7-cbdd-4745-8a9f-3558c5bb1d42 service nova] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-0decb5c5-24d2-470a-b02f-f8863976e97e req-2b499fd7-cbdd-4745-8a9f-3558c5bb1d42 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] No waiting events found dispatching network-vif-plugged-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:11:39 user nova-compute[74540]: WARNING nova.compute.manager [req-0decb5c5-24d2-470a-b02f-f8863976e97e req-2b499fd7-cbdd-4745-8a9f-3558c5bb1d42 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Received unexpected event network-vif-plugged-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 for instance with vm_state active and task_state deleting.
Nov 07 04:11:40 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:11:40 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Took 0.70 seconds to deallocate network for instance.
Nov 07 04:11:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:40 user nova-compute[74540]: DEBUG nova.objects.instance [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'flavor' on Instance uuid d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:11:40 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:11:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-c5eea61f-2e3f-47dd-8731-a625630f2f78 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.155s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:40 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:11:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:40 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Deleted allocations for instance d8608e1a-77c6-4156-812b-e73012d0b2d4
Nov 07 04:11:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50201288-8838-4eb1-83db-942e444da02f tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "d8608e1a-77c6-4156-812b-e73012d0b2d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.214s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:11:42 user nova-compute[74540]: DEBUG nova.compute.manager [req-33258bad-b581-4555-a07c-60c169278827 req-2bb77c19-40e0-4342-8a02-035ebb32b644 service nova] [instance: d8608e1a-77c6-4156-812b-e73012d0b2d4] Received event network-vif-deleted-3c53cd24-2f54-4031-b3b3-aea4c4fdb2a5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:42 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:11:42 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:11:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:42 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:11:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:11:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:11:47 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:11:47 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7693MB free_disk=25.020797729492188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance d61ec49c-3345-4808-bfcd-a9d925fe1918 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 20aefb10-e25b-4227-ba94-aaa411050d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:11:47 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:48 user nova-compute[74540]: INFO nova.compute.manager [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Terminating instance
Nov 07 04:11:48 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-40897f62-756a-4bf2-9603-cb5c0babe8de req-b683ffa0-80b5-434c-bd17-de4b37d60e1f service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Received event network-vif-unplugged-68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-40897f62-756a-4bf2-9603-cb5c0babe8de req-b683ffa0-80b5-434c-bd17-de4b37d60e1f service nova] Acquiring lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-40897f62-756a-4bf2-9603-cb5c0babe8de req-b683ffa0-80b5-434c-bd17-de4b37d60e1f service nova] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-40897f62-756a-4bf2-9603-cb5c0babe8de req-b683ffa0-80b5-434c-bd17-de4b37d60e1f service nova] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-40897f62-756a-4bf2-9603-cb5c0babe8de req-b683ffa0-80b5-434c-bd17-de4b37d60e1f service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] No waiting events found dispatching network-vif-unplugged-68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-40897f62-756a-4bf2-9603-cb5c0babe8de req-b683ffa0-80b5-434c-bd17-de4b37d60e1f service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Received event network-vif-unplugged-68a8f22b-c3f1-4575-b2f3-29af6c59af12 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:11:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:49 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Instance destroyed successfully.
Nov 07 04:11:49 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lazy-loading 'resources' on Instance uuid 5d120b2b-8d1b-4d19-8364-ab4dad61bad3 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1772667439',display_name='tempest-AttachVolumeNegativeTest-server-1772667439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1772667439',id=24,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANZIRK0djzkHWUv72oPiNJN+/Z03DvhkpML1H24uDTtZ9wofEjnoeD1A/JIq2OWLCdMQuoS7KxQ2nTwhxDaAE2IwBppbST8e/3+cnZgkSJAT/BuHuxadAAsqNCaLwBFCA==',key_name='tempest-keypair-310613541',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='620cefdadcec49d6a696aa7db8cef2d1',ramdisk_id='',reservation_id='r-sqydcp6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-306463361',owner_user_name='tempest-AttachVolumeNegativeTest-306463361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:08:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3079ba3a84ea4b4bb4a3e576ab4133ae',uuid=5d120b2b-8d1b-4d19-8364-ab4dad61bad3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "address": "fa:16:3e:f7:9f:73", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a8f22b-c3", "ovs_interfaceid": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converting VIF {"id": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "address": "fa:16:3e:f7:9f:73", "network": {"id": "4e4b0ad6-09e4-43e9-8769-53e624027dfe", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1504391542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "620cefdadcec49d6a696aa7db8cef2d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a8f22b-c3", "ovs_interfaceid": "68a8f22b-c3f1-4575-b2f3-29af6c59af12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=68a8f22b-c3f1-4575-b2f3-29af6c59af12,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a8f22b-c3') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG os_vif [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=68a8f22b-c3f1-4575-b2f3-29af6c59af12,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a8f22b-c3') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68a8f22b-c3, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d69fc186-fec3-45d8-9844-07cdba547dd2) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:49 user nova-compute[74540]: INFO os_vif [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:9f:73,bridge_name='br-int',has_traffic_filtering=True,id=68a8f22b-c3f1-4575-b2f3-29af6c59af12,network=Network(4e4b0ad6-09e4-43e9-8769-53e624027dfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a8f22b-c3')
Nov 07 04:11:49 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Deleting instance files /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3_del
Nov 07 04:11:49 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Deletion of /opt/stack/data/nova/instances/5d120b2b-8d1b-4d19-8364-ab4dad61bad3_del complete
Nov 07 04:11:49 user nova-compute[74540]: INFO nova.compute.manager [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 07 04:11:49 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:11:49 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:11:50 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Took 0.90 seconds to deallocate network for instance.
Nov 07 04:11:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-b3017ed5-af68-4c71-9591-e0e1609b1327 req-e89b7da7-64e5-48e2-9dab-27cacc6e4793 service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Received event network-vif-deleted-68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:50 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Deleted allocations for instance 5d120b2b-8d1b-4d19-8364-ab4dad61bad3
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e2ae8128-bb11-42f1-8c60-55bcd73ee598 tempest-AttachVolumeNegativeTest-306463361 tempest-AttachVolumeNegativeTest-306463361-project-member] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.328s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-9c494f62-2523-44c0-8880-2369074bfd6e req-1644669b-f083-4b6f-aa8d-4504cec1957a service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Received event network-vif-plugged-68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9c494f62-2523-44c0-8880-2369074bfd6e req-1644669b-f083-4b6f-aa8d-4504cec1957a service nova] Acquiring lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9c494f62-2523-44c0-8880-2369074bfd6e req-1644669b-f083-4b6f-aa8d-4504cec1957a service nova] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9c494f62-2523-44c0-8880-2369074bfd6e req-1644669b-f083-4b6f-aa8d-4504cec1957a service nova] Lock "5d120b2b-8d1b-4d19-8364-ab4dad61bad3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-9c494f62-2523-44c0-8880-2369074bfd6e req-1644669b-f083-4b6f-aa8d-4504cec1957a service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] No waiting events found dispatching network-vif-plugged-68a8f22b-c3f1-4575-b2f3-29af6c59af12 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:11:50 user nova-compute[74540]: WARNING nova.compute.manager [req-9c494f62-2523-44c0-8880-2369074bfd6e req-1644669b-f083-4b6f-aa8d-4504cec1957a service nova] [instance: 5d120b2b-8d1b-4d19-8364-ab4dad61bad3] Received unexpected event network-vif-plugged-68a8f22b-c3f1-4575-b2f3-29af6c59af12 for instance with vm_state deleted and task_state None.
Nov 07 04:11:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Updating instance_info_cache with network_info: [{"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-f146d8c3-a189-49da-84d0-b49dc77e4144" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:11:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:11:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:11:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:11:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:11:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:11:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:11:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:09 user nova-compute[74540]: INFO nova.compute.manager [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Terminating instance
Nov 07 04:12:09 user nova-compute[74540]: DEBUG nova.compute.manager [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:09 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Instance destroyed successfully.
Nov 07 04:12:09 user nova-compute[74540]: DEBUG nova.objects.instance [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'resources' on Instance uuid d61ec49c-3345-4808-bfcd-a9d925fe1918 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1133225386',display_name='tempest-ServerRescueNegativeTestJSON-server-1133225386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1133225386',id=20,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBj9JGEc9VyV8YeUoPMa9NDSJ54Ho4a2bbet4FxPNE2x3GRflCHypDOaqiWCZvHqb4axwgd1tVOhLjsH76krDJ7R06NDk6czZdeoCJ8xnQsEpDVmGkxfD1VqTkuh/PGlLA==',key_name='tempest-keypair-374854339',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:07:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60a9f3df6bba4675b2332ac4ded5373e',ramdisk_id='',reservation_id='r-jg0mo70g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1326022799',owner_user_name='tempest-ServerRescueNegativeTestJSON-1326022799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3b660fa816a404196af3027d19aea51',uuid=d61ec49c-3345-4808-bfcd-a9d925fe1918,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converting VIF {"id": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "address": "fa:16:3e:25:3f:df", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82decd3b-b1", "ovs_interfaceid": "82decd3b-b1ba-4b4c-88ab-fbae31e34394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:3f:df,bridge_name='br-int',has_traffic_filtering=True,id=82decd3b-b1ba-4b4c-88ab-fbae31e34394,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82decd3b-b1') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG os_vif [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:3f:df,bridge_name='br-int',has_traffic_filtering=True,id=82decd3b-b1ba-4b4c-88ab-fbae31e34394,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82decd3b-b1') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82decd3b-b1, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b7b047f-7701-43da-8893-20c79cf91047) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:12:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:09 user nova-compute[74540]: INFO os_vif [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:3f:df,bridge_name='br-int',has_traffic_filtering=True,id=82decd3b-b1ba-4b4c-88ab-fbae31e34394,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82decd3b-b1')
Nov 07 04:12:09 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Deleting instance files /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918_del
Nov 07 04:12:09 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Deletion of /opt/stack/data/nova/instances/d61ec49c-3345-4808-bfcd-a9d925fe1918_del complete
Nov 07 04:12:10 user nova-compute[74540]: INFO nova.compute.manager [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 07 04:12:10 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:12:10 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:12:10 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:12:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:11 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:12:11 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Took 1.33 seconds to deallocate network for instance.
Nov 07 04:12:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-ec1c64b0-c225-44b6-a2f5-d1ee85d9db0c req-f406839d-607c-40b7-8d47-4280808a8638 service nova] [instance: d61ec49c-3345-4808-bfcd-a9d925fe1918] Received event network-vif-deleted-82decd3b-b1ba-4b4c-88ab-fbae31e34394 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:11 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:12:11 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:12:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:11 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Deleted allocations for instance d61ec49c-3345-4808-bfcd-a9d925fe1918
Nov 07 04:12:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-87f6824b-b6ee-41c3-abeb-1026e75956e0 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "d61ec49c-3345-4808-bfcd-a9d925fe1918" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.781s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:14 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:12:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquired lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:12:14 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:12:14 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'info_cache' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:14 user nova-compute[74540]: DEBUG nova.objects.base [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updating instance_info_cache with network_info: [{"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Releasing lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:12:15 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance destroyed successfully.
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'resources' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.objects.base [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911941987',display_name='tempest-AttachVolumeTestJSON-server-1911941987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911941987',id=18,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZc0H8u9Sjs7UCPrYgQ/YYzLFW938ISChSSmxmxSC0YJVGNn+t+64OY9nQmYmr4BRKTp4XCwtT9CfL/C0bBD3MbQluNfqx9UtboWoTJuQ/vtZlZuy9FmbFmNS0Ski8AxQ==',key_name='tempest-keypair-1685201050',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='513e7858a1b34aa2bd5f363696b38f0a',ramdisk_id='',reservation_id='r-3y9w8i3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-540287196',owner_user_name='tempest-AttachVolumeTestJSON-540287196-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='791771e33e0645d6b97cef52f84d8b9c',uuid=80624b0b-4c6b-4d6f-9d31-2f7c81e39c79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converting VIF {"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG os_vif [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap134a19cd-7f, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dc19364-0237-4ccd-9ead-c2134352a25b) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:15 user nova-compute[74540]: INFO os_vif [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f')
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Start _get_guest_xml network_info=[{"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'numa_topology' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.objects.base [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:12:15 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:12:15 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.objects.base [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911941987',display_name='tempest-AttachVolumeTestJSON-server-1911941987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911941987',id=18,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZc0H8u9Sjs7UCPrYgQ/YYzLFW938ISChSSmxmxSC0YJVGNn+t+64OY9nQmYmr4BRKTp4XCwtT9CfL/C0bBD3MbQluNfqx9UtboWoTJuQ/vtZlZuy9FmbFmNS0Ski8AxQ==',key_name='tempest-keypair-1685201050',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='513e7858a1b34aa2bd5f363696b38f0a',ramdisk_id='',reservation_id='r-3y9w8i3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-540287196',owner_user_name='tempest-AttachVolumeTestJSON-540287196-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='791771e33e0645d6b97cef52f84d8b9c',uuid=80624b0b-4c6b-4d6f-9d31-2f7c81e39c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converting VIF {"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'pci_devices' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.objects.base [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:12:15 user nova-compute[74540]:   <uuid>80624b0b-4c6b-4d6f-9d31-2f7c81e39c79</uuid>
Nov 07 04:12:15 user nova-compute[74540]:   <name>instance-00000012</name>
Nov 07 04:12:15 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:12:15 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:12:15 user nova-compute[74540]:   <metadata>
Nov 07 04:12:15 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:12:15 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:12:15 user nova-compute[74540]:       <nova:name>tempest-AttachVolumeTestJSON-server-1911941987</nova:name>
Nov 07 04:12:15 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:12:15</nova:creationTime>
Nov 07 04:12:15 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:12:15 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:12:15 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:12:15 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:12:15 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:12:15 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:12:15 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:12:15 user nova-compute[74540]:       <nova:owner>
Nov 07 04:12:15 user nova-compute[74540]:         <nova:user uuid="791771e33e0645d6b97cef52f84d8b9c">tempest-AttachVolumeTestJSON-540287196-project-member</nova:user>
Nov 07 04:12:15 user nova-compute[74540]:         <nova:project uuid="513e7858a1b34aa2bd5f363696b38f0a">tempest-AttachVolumeTestJSON-540287196</nova:project>
Nov 07 04:12:15 user nova-compute[74540]:       </nova:owner>
Nov 07 04:12:15 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:12:15 user nova-compute[74540]:       <nova:ports>
Nov 07 04:12:15 user nova-compute[74540]:         <nova:port uuid="134a19cd-7f72-44e1-82c0-5ffab04d98b6">
Nov 07 04:12:15 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 04:12:15 user nova-compute[74540]:         </nova:port>
Nov 07 04:12:15 user nova-compute[74540]:       </nova:ports>
Nov 07 04:12:15 user nova-compute[74540]:     </nova:instance>
Nov 07 04:12:15 user nova-compute[74540]:   </metadata>
Nov 07 04:12:15 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:12:15 user nova-compute[74540]:     <system>
Nov 07 04:12:15 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:12:15 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:12:15 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:12:15 user nova-compute[74540]:       <entry name="serial">80624b0b-4c6b-4d6f-9d31-2f7c81e39c79</entry>
Nov 07 04:12:15 user nova-compute[74540]:       <entry name="uuid">80624b0b-4c6b-4d6f-9d31-2f7c81e39c79</entry>
Nov 07 04:12:15 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:12:15 user nova-compute[74540]:     </system>
Nov 07 04:12:15 user nova-compute[74540]:   </sysinfo>
Nov 07 04:12:15 user nova-compute[74540]:   <os>
Nov 07 04:12:15 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:12:15 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:12:15 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:12:15 user nova-compute[74540]:   </os>
Nov 07 04:12:15 user nova-compute[74540]:   <features>
Nov 07 04:12:15 user nova-compute[74540]:     <acpi/>
Nov 07 04:12:15 user nova-compute[74540]:     <apic/>
Nov 07 04:12:15 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:12:15 user nova-compute[74540]:   </features>
Nov 07 04:12:15 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:12:15 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:12:15 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:12:15 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:12:15 user nova-compute[74540]:   </clock>
Nov 07 04:12:15 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:12:15 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:12:15 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:12:15 user nova-compute[74540]:   </cpu>
Nov 07 04:12:15 user nova-compute[74540]:   <devices>
Nov 07 04:12:15 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:12:15 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:12:15 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk"/>
Nov 07 04:12:15 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:12:15 user nova-compute[74540]:     </disk>
Nov 07 04:12:15 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:12:15 user nova-compute[74540]:       <mac address="fa:16:3e:53:d9:ef"/>
Nov 07 04:12:15 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:12:15 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:12:15 user nova-compute[74540]:       <target dev="tap134a19cd-7f"/>
Nov 07 04:12:15 user nova-compute[74540]:     </interface>
Nov 07 04:12:15 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:12:15 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/console.log" append="off"/>
Nov 07 04:12:15 user nova-compute[74540]:     </serial>
Nov 07 04:12:15 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:12:15 user nova-compute[74540]:     <video>
Nov 07 04:12:15 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:12:15 user nova-compute[74540]:     </video>
Nov 07 04:12:15 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:12:15 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:12:15 user nova-compute[74540]:     </rng>
Nov 07 04:12:15 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:12:15 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:12:15 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:12:15 user nova-compute[74540]:     </memballoon>
Nov 07 04:12:15 user nova-compute[74540]:   </devices>
Nov 07 04:12:15 user nova-compute[74540]: </domain>
Nov 07 04:12:15 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'trusted_certs' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG nova.objects.base [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Cannot resize image /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'migration_context' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG nova.objects.base [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Object Instance<80624b0b-4c6b-4d6f-9d31-2f7c81e39c79> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911941987',display_name='tempest-AttachVolumeTestJSON-server-1911941987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911941987',id=18,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZc0H8u9Sjs7UCPrYgQ/YYzLFW938ISChSSmxmxSC0YJVGNn+t+64OY9nQmYmr4BRKTp4XCwtT9CfL/C0bBD3MbQluNfqx9UtboWoTJuQ/vtZlZuy9FmbFmNS0Ski8AxQ==',key_name='tempest-keypair-1685201050',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='513e7858a1b34aa2bd5f363696b38f0a',ramdisk_id='',reservation_id='r-3y9w8i3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-540287196',owner_user_name='tempest-AttachVolumeTestJSON-540287196-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='791771e33e0645d6b97cef52f84d8b9c',uuid=80624b0b-4c6b-4d6f-9d31-2f7c81e39c79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converting VIF {"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG os_vif [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcc936cd-f2bc-5060-88af-a79f2136c4ca', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap134a19cd-7f, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap134a19cd-7f, col_values=(('qos', UUID('eabb7553-ba06-4ea9-8dbe-781a91e1bd08')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap134a19cd-7f, col_values=(('external_ids', {'iface-id': '134a19cd-7f72-44e1-82c0-5ffab04d98b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:d9:ef', 'vm-uuid': '80624b0b-4c6b-4d6f-9d31-2f7c81e39c79'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:12:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:16 user nova-compute[74540]: INFO os_vif [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f')
Nov 07 04:12:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:12:20 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance rebooted successfully.
Nov 07 04:12:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7c21523b-ad5b-4316-a47f-9cf383b1a879 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:12:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:12:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:20 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:12:20 user nova-compute[74540]: INFO nova.compute.claims [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Claim successful on node user
Nov 07 04:12:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:20 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:12:20 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG nova.network.neutron [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:12:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:12:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:12:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Creating image(s)
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "/opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "/opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG nova.policy [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3580d0b365fa4f2f8599747d474e8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f9a52c6a1044b8bc854c8a86d81827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.203s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.235s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk 1073741824" returned: 0 in 0.050s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.230s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Successfully created port: 6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Cannot resize image /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Ensure instance console log exists: /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-4f72efc7-0f67-4f7f-8de8-d4bc9de1ce28 req-f3ad771f-8f7d-476e-b03a-5c4cc89aac98 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4f72efc7-0f67-4f7f-8de8-d4bc9de1ce28 req-f3ad771f-8f7d-476e-b03a-5c4cc89aac98 service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4f72efc7-0f67-4f7f-8de8-d4bc9de1ce28 req-f3ad771f-8f7d-476e-b03a-5c4cc89aac98 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4f72efc7-0f67-4f7f-8de8-d4bc9de1ce28 req-f3ad771f-8f7d-476e-b03a-5c4cc89aac98 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-4f72efc7-0f67-4f7f-8de8-d4bc9de1ce28 req-f3ad771f-8f7d-476e-b03a-5c4cc89aac98 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:12:22 user nova-compute[74540]: WARNING nova.compute.manager [req-4f72efc7-0f67-4f7f-8de8-d4bc9de1ce28 req-f3ad771f-8f7d-476e-b03a-5c4cc89aac98 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state active and task_state None.
Nov 07 04:12:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Successfully updated port: 6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquired lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-23026c98-eb21-4815-9c1b-8811f82b1f25 req-2a874a1a-7952-4684-ba62-1e3ed89d256e service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Received event network-changed-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-23026c98-eb21-4815-9c1b-8811f82b1f25 req-2a874a1a-7952-4684-ba62-1e3ed89d256e service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Refreshing instance network info cache due to event network-changed-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:12:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-23026c98-eb21-4815-9c1b-8811f82b1f25 req-2a874a1a-7952-4684-ba62-1e3ed89d256e service nova] Acquiring lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.network.neutron [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.network.neutron [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Updating instance_info_cache with network_info: [{"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Releasing lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Instance network_info: |[{"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-23026c98-eb21-4815-9c1b-8811f82b1f25 req-2a874a1a-7952-4684-ba62-1e3ed89d256e service nova] Acquired lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-23026c98-eb21-4815-9c1b-8811f82b1f25 req-2a874a1a-7952-4684-ba62-1e3ed89d256e service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Refreshing network info cache for port 6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Start _get_guest_xml network_info=[{"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:12:23 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:12:23 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2033855906',display_name='tempest-TestStampPattern-server-2033855906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2033855906',id=29,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoMfE2Q8gNUKNl0nmrHkjFV2OAeuMJzS+ql/IUfGPF1eNzZ6Aqxy5NrG9xZoAUwwIFWT3HNiNLxHgs0GzsPBY0ju025YOE6ZmiTIQk/+eBuGfERE2Lyjk3Ye8OTrYx9mA==',key_name='tempest-TestStampPattern-1539418775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29f9a52c6a1044b8bc854c8a86d81827',ramdisk_id='',reservation_id='r-2djk30s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-310684050',owner_user_name='tempest-TestStampPattern-310684050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:12:21Z,user_data=None,user_id='3580d0b365fa4f2f8599747d474e8c7e',uuid=cc15c8fc-e47f-4df0-94ec-8daeacb112c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Converting VIF {"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=6e16179f-e4b8-4bda-a240-bb9ab9fadaf5,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e16179f-e4') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.objects.instance [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lazy-loading 'pci_devices' on Instance uuid cc15c8fc-e47f-4df0-94ec-8daeacb112c9 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:12:23 user nova-compute[74540]:   <uuid>cc15c8fc-e47f-4df0-94ec-8daeacb112c9</uuid>
Nov 07 04:12:23 user nova-compute[74540]:   <name>instance-0000001d</name>
Nov 07 04:12:23 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:12:23 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:12:23 user nova-compute[74540]:   <metadata>
Nov 07 04:12:23 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:12:23 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:12:23 user nova-compute[74540]:       <nova:name>tempest-TestStampPattern-server-2033855906</nova:name>
Nov 07 04:12:23 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:12:23</nova:creationTime>
Nov 07 04:12:23 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:12:23 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:12:23 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:12:23 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:12:23 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:12:23 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:12:23 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:12:23 user nova-compute[74540]:       <nova:owner>
Nov 07 04:12:23 user nova-compute[74540]:         <nova:user uuid="3580d0b365fa4f2f8599747d474e8c7e">tempest-TestStampPattern-310684050-project-member</nova:user>
Nov 07 04:12:23 user nova-compute[74540]:         <nova:project uuid="29f9a52c6a1044b8bc854c8a86d81827">tempest-TestStampPattern-310684050</nova:project>
Nov 07 04:12:23 user nova-compute[74540]:       </nova:owner>
Nov 07 04:12:23 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:12:23 user nova-compute[74540]:       <nova:ports>
Nov 07 04:12:23 user nova-compute[74540]:         <nova:port uuid="6e16179f-e4b8-4bda-a240-bb9ab9fadaf5">
Nov 07 04:12:23 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 07 04:12:23 user nova-compute[74540]:         </nova:port>
Nov 07 04:12:23 user nova-compute[74540]:       </nova:ports>
Nov 07 04:12:23 user nova-compute[74540]:     </nova:instance>
Nov 07 04:12:23 user nova-compute[74540]:   </metadata>
Nov 07 04:12:23 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:12:23 user nova-compute[74540]:     <system>
Nov 07 04:12:23 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:12:23 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:12:23 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:12:23 user nova-compute[74540]:       <entry name="serial">cc15c8fc-e47f-4df0-94ec-8daeacb112c9</entry>
Nov 07 04:12:23 user nova-compute[74540]:       <entry name="uuid">cc15c8fc-e47f-4df0-94ec-8daeacb112c9</entry>
Nov 07 04:12:23 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:12:23 user nova-compute[74540]:     </system>
Nov 07 04:12:23 user nova-compute[74540]:   </sysinfo>
Nov 07 04:12:23 user nova-compute[74540]:   <os>
Nov 07 04:12:23 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:12:23 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:12:23 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:12:23 user nova-compute[74540]:   </os>
Nov 07 04:12:23 user nova-compute[74540]:   <features>
Nov 07 04:12:23 user nova-compute[74540]:     <acpi/>
Nov 07 04:12:23 user nova-compute[74540]:     <apic/>
Nov 07 04:12:23 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:12:23 user nova-compute[74540]:   </features>
Nov 07 04:12:23 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:12:23 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:12:23 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:12:23 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:12:23 user nova-compute[74540]:   </clock>
Nov 07 04:12:23 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:12:23 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:12:23 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:12:23 user nova-compute[74540]:   </cpu>
Nov 07 04:12:23 user nova-compute[74540]:   <devices>
Nov 07 04:12:23 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:12:23 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:12:23 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk"/>
Nov 07 04:12:23 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:12:23 user nova-compute[74540]:     </disk>
Nov 07 04:12:23 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:12:23 user nova-compute[74540]:       <mac address="fa:16:3e:7f:b8:4d"/>
Nov 07 04:12:23 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:12:23 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:12:23 user nova-compute[74540]:       <target dev="tap6e16179f-e4"/>
Nov 07 04:12:23 user nova-compute[74540]:     </interface>
Nov 07 04:12:23 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:12:23 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/console.log" append="off"/>
Nov 07 04:12:23 user nova-compute[74540]:     </serial>
Nov 07 04:12:23 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:12:23 user nova-compute[74540]:     <video>
Nov 07 04:12:23 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:12:23 user nova-compute[74540]:     </video>
Nov 07 04:12:23 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:12:23 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:12:23 user nova-compute[74540]:     </rng>
Nov 07 04:12:23 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:12:23 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:12:23 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:12:23 user nova-compute[74540]:     </memballoon>
Nov 07 04:12:23 user nova-compute[74540]:   </devices>
Nov 07 04:12:23 user nova-compute[74540]: </domain>
Nov 07 04:12:23 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2033855906',display_name='tempest-TestStampPattern-server-2033855906',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2033855906',id=29,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoMfE2Q8gNUKNl0nmrHkjFV2OAeuMJzS+ql/IUfGPF1eNzZ6Aqxy5NrG9xZoAUwwIFWT3HNiNLxHgs0GzsPBY0ju025YOE6ZmiTIQk/+eBuGfERE2Lyjk3Ye8OTrYx9mA==',key_name='tempest-TestStampPattern-1539418775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29f9a52c6a1044b8bc854c8a86d81827',ramdisk_id='',reservation_id='r-2djk30s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-310684050',owner_user_name='tempest-TestStampPattern-310684050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:12:21Z,user_data=None,user_id='3580d0b365fa4f2f8599747d474e8c7e',uuid=cc15c8fc-e47f-4df0-94ec-8daeacb112c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Converting VIF {"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=6e16179f-e4b8-4bda-a240-bb9ab9fadaf5,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e16179f-e4') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG os_vif [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=6e16179f-e4b8-4bda-a240-bb9ab9fadaf5,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e16179f-e4') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a3577c8-7fdc-5e9f-afa6-da06e84f5a25', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e16179f-e4, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e16179f-e4, col_values=(('qos', UUID('f3e87ba2-be31-45b1-a403-ecc5dc3cf7c0')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e16179f-e4, col_values=(('external_ids', {'iface-id': '6e16179f-e4b8-4bda-a240-bb9ab9fadaf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:b8:4d', 'vm-uuid': 'cc15c8fc-e47f-4df0-94ec-8daeacb112c9'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:23 user nova-compute[74540]: INFO os_vif [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=6e16179f-e4b8-4bda-a240-bb9ab9fadaf5,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e16179f-e4')
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] No VIF found with MAC fa:16:3e:7f:b8:4d, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-23026c98-eb21-4815-9c1b-8811f82b1f25 req-2a874a1a-7952-4684-ba62-1e3ed89d256e service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Updated VIF entry in instance network info cache for port 6e16179f-e4b8-4bda-a240-bb9ab9fadaf5. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-23026c98-eb21-4815-9c1b-8811f82b1f25 req-2a874a1a-7952-4684-ba62-1e3ed89d256e service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Updating instance_info_cache with network_info: [{"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:12:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-23026c98-eb21-4815-9c1b-8811f82b1f25 req-2a874a1a-7952-4684-ba62-1e3ed89d256e service nova] Releasing lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:12:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-052a6dde-8d28-446d-99af-d60266ed297b req-34c1b62a-ef28-4894-8d2e-833b048c8fba service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-052a6dde-8d28-446d-99af-d60266ed297b req-34c1b62a-ef28-4894-8d2e-833b048c8fba service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-052a6dde-8d28-446d-99af-d60266ed297b req-34c1b62a-ef28-4894-8d2e-833b048c8fba service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-052a6dde-8d28-446d-99af-d60266ed297b req-34c1b62a-ef28-4894-8d2e-833b048c8fba service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-052a6dde-8d28-446d-99af-d60266ed297b req-34c1b62a-ef28-4894-8d2e-833b048c8fba service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:12:24 user nova-compute[74540]: WARNING nova.compute.manager [req-052a6dde-8d28-446d-99af-d60266ed297b req-34c1b62a-ef28-4894-8d2e-833b048c8fba service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state active and task_state None.
Nov 07 04:12:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-3ffdd311-82d4-40bf-8354-c67bb49a1d07 req-4d880281-4597-4cec-8b15-f1f51d0089b0 service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Received event network-vif-plugged-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3ffdd311-82d4-40bf-8354-c67bb49a1d07 req-4d880281-4597-4cec-8b15-f1f51d0089b0 service nova] Acquiring lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3ffdd311-82d4-40bf-8354-c67bb49a1d07 req-4d880281-4597-4cec-8b15-f1f51d0089b0 service nova] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3ffdd311-82d4-40bf-8354-c67bb49a1d07 req-4d880281-4597-4cec-8b15-f1f51d0089b0 service nova] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-3ffdd311-82d4-40bf-8354-c67bb49a1d07 req-4d880281-4597-4cec-8b15-f1f51d0089b0 service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] No waiting events found dispatching network-vif-plugged-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:12:25 user nova-compute[74540]: WARNING nova.compute.manager [req-3ffdd311-82d4-40bf-8354-c67bb49a1d07 req-4d880281-4597-4cec-8b15-f1f51d0089b0 service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Received unexpected event network-vif-plugged-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 for instance with vm_state building and task_state spawning.
Nov 07 04:12:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-b779b36e-f8ed-4d7a-85e8-a4f41d27f48f req-e2697120-4cbb-4169-938e-7cdf8726935f service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Received event network-changed-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-b779b36e-f8ed-4d7a-85e8-a4f41d27f48f req-e2697120-4cbb-4169-938e-7cdf8726935f service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Refreshing instance network info cache due to event network-changed-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:12:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b779b36e-f8ed-4d7a-85e8-a4f41d27f48f req-e2697120-4cbb-4169-938e-7cdf8726935f service nova] Acquiring lock "refresh_cache-20aefb10-e25b-4227-ba94-aaa411050d80" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:12:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b779b36e-f8ed-4d7a-85e8-a4f41d27f48f req-e2697120-4cbb-4169-938e-7cdf8726935f service nova] Acquired lock "refresh_cache-20aefb10-e25b-4227-ba94-aaa411050d80" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:12:26 user nova-compute[74540]: DEBUG nova.network.neutron [req-b779b36e-f8ed-4d7a-85e8-a4f41d27f48f req-e2697120-4cbb-4169-938e-7cdf8726935f service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Refreshing network info cache for port e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:12:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "20aefb10-e25b-4227-ba94-aaa411050d80" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "20aefb10-e25b-4227-ba94-aaa411050d80" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:26 user nova-compute[74540]: DEBUG nova.objects.instance [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lazy-loading 'flavor' on Instance uuid 20aefb10-e25b-4227-ba94-aaa411050d80 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:26 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Ignoring supplied device name: /dev/vdb
Nov 07 04:12:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "20aefb10-e25b-4227-ba94-aaa411050d80" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.network.neutron [req-b779b36e-f8ed-4d7a-85e8-a4f41d27f48f req-e2697120-4cbb-4169-938e-7cdf8726935f service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Updated VIF entry in instance network info cache for port e6b49c82-01c9-4c16-90ca-93a9faf2d5a0. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.network.neutron [req-b779b36e-f8ed-4d7a-85e8-a4f41d27f48f req-e2697120-4cbb-4169-938e-7cdf8726935f service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Updating instance_info_cache with network_info: [{"id": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "address": "fa:16:3e:ea:cb:59", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b49c82-01", "ovs_interfaceid": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b779b36e-f8ed-4d7a-85e8-a4f41d27f48f req-e2697120-4cbb-4169-938e-7cdf8726935f service nova] Releasing lock "refresh_cache-20aefb10-e25b-4227-ba94-aaa411050d80" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.compute.manager [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:12:27 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Instance spawned successfully.
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-d45da20e-349c-44ab-8f3a-f3b7a8a0fa3b req-6947303c-478b-4c68-ab3e-4637726ec800 service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Received event network-vif-plugged-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d45da20e-349c-44ab-8f3a-f3b7a8a0fa3b req-6947303c-478b-4c68-ab3e-4637726ec800 service nova] Acquiring lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d45da20e-349c-44ab-8f3a-f3b7a8a0fa3b req-6947303c-478b-4c68-ab3e-4637726ec800 service nova] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d45da20e-349c-44ab-8f3a-f3b7a8a0fa3b req-6947303c-478b-4c68-ab3e-4637726ec800 service nova] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-d45da20e-349c-44ab-8f3a-f3b7a8a0fa3b req-6947303c-478b-4c68-ab3e-4637726ec800 service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] No waiting events found dispatching network-vif-plugged-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:12:27 user nova-compute[74540]: WARNING nova.compute.manager [req-d45da20e-349c-44ab-8f3a-f3b7a8a0fa3b req-6947303c-478b-4c68-ab3e-4637726ec800 service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Received unexpected event network-vif-plugged-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 for instance with vm_state building and task_state spawning.
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "20aefb10-e25b-4227-ba94-aaa411050d80" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "20aefb10-e25b-4227-ba94-aaa411050d80" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:27 user nova-compute[74540]: INFO nova.compute.manager [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Attaching volume d4880b4b-db43-41a1-8181-c3fb93f5a79c to /dev/vdb
Nov 07 04:12:27 user nova-compute[74540]: INFO nova.compute.manager [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.compute.manager [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG os_brick.utils [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e17f0f2-ae39-427e-b83c-805713fd623f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3c1013-556f-46ff-9f64-b615d303d9ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3f5896-331f-41e9-9696-801923221c7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a426cee-71d9-49a4-a682-d2f0ef2e67f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:12:27 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[13031120-737c-44df-8538-c1ccb08962e7]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:27 user nova-compute[74540]: INFO nova.compute.manager [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Took 6.88 seconds to build instance.
Nov 07 04:12:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG os_brick.utils [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Updating existing volume attachment record: 1f70b959-f1f3-4004-81be-437c0393c128 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:12:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-123940e0-43bd-459c-8bff-9746df860adc tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.991s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "385719ec-63d8-4c6d-a366-92fe921e70a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:12:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:30 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:12:30 user nova-compute[74540]: INFO nova.compute.claims [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Claim successful on node user
Nov 07 04:12:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG nova.network.neutron [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:12:31 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:12:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG nova.policy [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19215be651f54d5aa160548205a6dc93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b13ca54283e24792a14346398c50e8c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:12:31 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Creating image(s)
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "/opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "/opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "/opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.230s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG nova.network.neutron [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Successfully created port: 799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk 1073741824" returned: 0 in 0.053s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.202s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Checking if we can resize image /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Cannot resize image /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Ensure instance console log exists: /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Successfully updated port: 799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "refresh_cache-385719ec-63d8-4c6d-a366-92fe921e70a6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquired lock "refresh_cache-385719ec-63d8-4c6d-a366-92fe921e70a6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG nova.compute.manager [req-338c96f0-b1b9-47c4-a08a-49ac3df14e3c req-46696b00-ae4a-4823-96d6-06f63502a9ee service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Received event network-changed-799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG nova.compute.manager [req-338c96f0-b1b9-47c4-a08a-49ac3df14e3c req-46696b00-ae4a-4823-96d6-06f63502a9ee service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Refreshing instance network info cache due to event network-changed-799c3fc0-d40b-4411-bd8d-44f080a0eead. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-338c96f0-b1b9-47c4-a08a-49ac3df14e3c req-46696b00-ae4a-4823-96d6-06f63502a9ee service nova] Acquiring lock "refresh_cache-385719ec-63d8-4c6d-a366-92fe921e70a6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:12:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.network.neutron [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Updating instance_info_cache with network_info: [{"id": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "address": "fa:16:3e:a1:23:73", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c3fc0-d4", "ovs_interfaceid": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Releasing lock "refresh_cache-385719ec-63d8-4c6d-a366-92fe921e70a6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.compute.manager [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Instance network_info: |[{"id": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "address": "fa:16:3e:a1:23:73", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c3fc0-d4", "ovs_interfaceid": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-338c96f0-b1b9-47c4-a08a-49ac3df14e3c req-46696b00-ae4a-4823-96d6-06f63502a9ee service nova] Acquired lock "refresh_cache-385719ec-63d8-4c6d-a366-92fe921e70a6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.network.neutron [req-338c96f0-b1b9-47c4-a08a-49ac3df14e3c req-46696b00-ae4a-4823-96d6-06f63502a9ee service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Refreshing network info cache for port 799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Start _get_guest_xml network_info=[{"id": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "address": "fa:16:3e:a1:23:73", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c3fc0-d4", "ovs_interfaceid": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:12:33 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:12:33 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-914371902',display_name='tempest-VolumesActionsTest-instance-914371902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-914371902',id=30,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13ca54283e24792a14346398c50e8c9',ramdisk_id='',reservation_id='r-m083w4tl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1216468883',owner_user_name='tempest-VolumesActionsTest-1216468883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:12:31Z,user_data=None,user_id='19215be651f54d5aa160548205a6dc93',uuid=385719ec-63d8-4c6d-a366-92fe921e70a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "address": "fa:16:3e:a1:23:73", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c3fc0-d4", "ovs_interfaceid": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Converting VIF {"id": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "address": "fa:16:3e:a1:23:73", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c3fc0-d4", "ovs_interfaceid": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:23:73,bridge_name='br-int',has_traffic_filtering=True,id=799c3fc0-d40b-4411-bd8d-44f080a0eead,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c3fc0-d4') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.objects.instance [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lazy-loading 'pci_devices' on Instance uuid 385719ec-63d8-4c6d-a366-92fe921e70a6 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:12:33 user nova-compute[74540]:   <uuid>385719ec-63d8-4c6d-a366-92fe921e70a6</uuid>
Nov 07 04:12:33 user nova-compute[74540]:   <name>instance-0000001e</name>
Nov 07 04:12:33 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:12:33 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:12:33 user nova-compute[74540]:   <metadata>
Nov 07 04:12:33 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:12:33 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:12:33 user nova-compute[74540]:       <nova:name>tempest-VolumesActionsTest-instance-914371902</nova:name>
Nov 07 04:12:33 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:12:33</nova:creationTime>
Nov 07 04:12:33 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:12:33 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:12:33 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:12:33 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:12:33 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:12:33 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:12:33 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:12:33 user nova-compute[74540]:       <nova:owner>
Nov 07 04:12:33 user nova-compute[74540]:         <nova:user uuid="19215be651f54d5aa160548205a6dc93">tempest-VolumesActionsTest-1216468883-project-member</nova:user>
Nov 07 04:12:33 user nova-compute[74540]:         <nova:project uuid="b13ca54283e24792a14346398c50e8c9">tempest-VolumesActionsTest-1216468883</nova:project>
Nov 07 04:12:33 user nova-compute[74540]:       </nova:owner>
Nov 07 04:12:33 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:12:33 user nova-compute[74540]:       <nova:ports>
Nov 07 04:12:33 user nova-compute[74540]:         <nova:port uuid="799c3fc0-d40b-4411-bd8d-44f080a0eead">
Nov 07 04:12:33 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 07 04:12:33 user nova-compute[74540]:         </nova:port>
Nov 07 04:12:33 user nova-compute[74540]:       </nova:ports>
Nov 07 04:12:33 user nova-compute[74540]:     </nova:instance>
Nov 07 04:12:33 user nova-compute[74540]:   </metadata>
Nov 07 04:12:33 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:12:33 user nova-compute[74540]:     <system>
Nov 07 04:12:33 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:12:33 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:12:33 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:12:33 user nova-compute[74540]:       <entry name="serial">385719ec-63d8-4c6d-a366-92fe921e70a6</entry>
Nov 07 04:12:33 user nova-compute[74540]:       <entry name="uuid">385719ec-63d8-4c6d-a366-92fe921e70a6</entry>
Nov 07 04:12:33 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:12:33 user nova-compute[74540]:     </system>
Nov 07 04:12:33 user nova-compute[74540]:   </sysinfo>
Nov 07 04:12:33 user nova-compute[74540]:   <os>
Nov 07 04:12:33 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:12:33 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:12:33 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:12:33 user nova-compute[74540]:   </os>
Nov 07 04:12:33 user nova-compute[74540]:   <features>
Nov 07 04:12:33 user nova-compute[74540]:     <acpi/>
Nov 07 04:12:33 user nova-compute[74540]:     <apic/>
Nov 07 04:12:33 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:12:33 user nova-compute[74540]:   </features>
Nov 07 04:12:33 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:12:33 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:12:33 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:12:33 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:12:33 user nova-compute[74540]:   </clock>
Nov 07 04:12:33 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:12:33 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:12:33 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:12:33 user nova-compute[74540]:   </cpu>
Nov 07 04:12:33 user nova-compute[74540]:   <devices>
Nov 07 04:12:33 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:12:33 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:12:33 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk"/>
Nov 07 04:12:33 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:12:33 user nova-compute[74540]:     </disk>
Nov 07 04:12:33 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:12:33 user nova-compute[74540]:       <mac address="fa:16:3e:a1:23:73"/>
Nov 07 04:12:33 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:12:33 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:12:33 user nova-compute[74540]:       <target dev="tap799c3fc0-d4"/>
Nov 07 04:12:33 user nova-compute[74540]:     </interface>
Nov 07 04:12:33 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:12:33 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/console.log" append="off"/>
Nov 07 04:12:33 user nova-compute[74540]:     </serial>
Nov 07 04:12:33 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:12:33 user nova-compute[74540]:     <video>
Nov 07 04:12:33 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:12:33 user nova-compute[74540]:     </video>
Nov 07 04:12:33 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:12:33 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:12:33 user nova-compute[74540]:     </rng>
Nov 07 04:12:33 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:12:33 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:12:33 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:12:33 user nova-compute[74540]:     </memballoon>
Nov 07 04:12:33 user nova-compute[74540]:   </devices>
Nov 07 04:12:33 user nova-compute[74540]: </domain>
Nov 07 04:12:33 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-914371902',display_name='tempest-VolumesActionsTest-instance-914371902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-914371902',id=30,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b13ca54283e24792a14346398c50e8c9',ramdisk_id='',reservation_id='r-m083w4tl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1216468883',owner_user_name='tempest-VolumesActionsTest-1216468883-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:12:31Z,user_data=None,user_id='19215be651f54d5aa160548205a6dc93',uuid=385719ec-63d8-4c6d-a366-92fe921e70a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "address": "fa:16:3e:a1:23:73", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c3fc0-d4", "ovs_interfaceid": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Converting VIF {"id": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "address": "fa:16:3e:a1:23:73", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c3fc0-d4", "ovs_interfaceid": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:23:73,bridge_name='br-int',has_traffic_filtering=True,id=799c3fc0-d40b-4411-bd8d-44f080a0eead,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c3fc0-d4') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG os_vif [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:23:73,bridge_name='br-int',has_traffic_filtering=True,id=799c3fc0-d40b-4411-bd8d-44f080a0eead,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c3fc0-d4') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac530633-e46c-58bf-98c5-40a9392096c1', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap799c3fc0-d4, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap799c3fc0-d4, col_values=(('qos', UUID('9b45df42-fd88-4be3-b5f0-e50d63a154df')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap799c3fc0-d4, col_values=(('external_ids', {'iface-id': '799c3fc0-d40b-4411-bd8d-44f080a0eead', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:23:73', 'vm-uuid': '385719ec-63d8-4c6d-a366-92fe921e70a6'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:33 user nova-compute[74540]: INFO os_vif [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:23:73,bridge_name='br-int',has_traffic_filtering=True,id=799c3fc0-d40b-4411-bd8d-44f080a0eead,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c3fc0-d4')
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] No VIF found with MAC fa:16:3e:a1:23:73, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.network.neutron [req-338c96f0-b1b9-47c4-a08a-49ac3df14e3c req-46696b00-ae4a-4823-96d6-06f63502a9ee service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Updated VIF entry in instance network info cache for port 799c3fc0-d40b-4411-bd8d-44f080a0eead. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG nova.network.neutron [req-338c96f0-b1b9-47c4-a08a-49ac3df14e3c req-46696b00-ae4a-4823-96d6-06f63502a9ee service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Updating instance_info_cache with network_info: [{"id": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "address": "fa:16:3e:a1:23:73", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c3fc0-d4", "ovs_interfaceid": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:12:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-338c96f0-b1b9-47c4-a08a-49ac3df14e3c req-46696b00-ae4a-4823-96d6-06f63502a9ee service nova] Releasing lock "refresh_cache-385719ec-63d8-4c6d-a366-92fe921e70a6" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:12:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:34 user nova-compute[74540]: DEBUG nova.compute.manager [req-81f9e32e-1491-4a1a-94d6-392077c30f74 req-90d9ca02-0507-45fa-9a20-c92f0889a39e service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Received event network-vif-plugged-799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-81f9e32e-1491-4a1a-94d6-392077c30f74 req-90d9ca02-0507-45fa-9a20-c92f0889a39e service nova] Acquiring lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-81f9e32e-1491-4a1a-94d6-392077c30f74 req-90d9ca02-0507-45fa-9a20-c92f0889a39e service nova] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-81f9e32e-1491-4a1a-94d6-392077c30f74 req-90d9ca02-0507-45fa-9a20-c92f0889a39e service nova] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:34 user nova-compute[74540]: DEBUG nova.compute.manager [req-81f9e32e-1491-4a1a-94d6-392077c30f74 req-90d9ca02-0507-45fa-9a20-c92f0889a39e service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] No waiting events found dispatching network-vif-plugged-799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:12:34 user nova-compute[74540]: WARNING nova.compute.manager [req-81f9e32e-1491-4a1a-94d6-392077c30f74 req-90d9ca02-0507-45fa-9a20-c92f0889a39e service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Received unexpected event network-vif-plugged-799c3fc0-d40b-4411-bd8d-44f080a0eead for instance with vm_state building and task_state spawning.
Nov 07 04:12:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:35 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-f7c1d509-a13d-4f0f-a1b8-dd2df7062a8f req-df784159-79dc-4b0a-8a94-eb8ad65d1f7c service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Received event network-vif-plugged-799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f7c1d509-a13d-4f0f-a1b8-dd2df7062a8f req-df784159-79dc-4b0a-8a94-eb8ad65d1f7c service nova] Acquiring lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f7c1d509-a13d-4f0f-a1b8-dd2df7062a8f req-df784159-79dc-4b0a-8a94-eb8ad65d1f7c service nova] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f7c1d509-a13d-4f0f-a1b8-dd2df7062a8f req-df784159-79dc-4b0a-8a94-eb8ad65d1f7c service nova] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-f7c1d509-a13d-4f0f-a1b8-dd2df7062a8f req-df784159-79dc-4b0a-8a94-eb8ad65d1f7c service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] No waiting events found dispatching network-vif-plugged-799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:12:37 user nova-compute[74540]: WARNING nova.compute.manager [req-f7c1d509-a13d-4f0f-a1b8-dd2df7062a8f req-df784159-79dc-4b0a-8a94-eb8ad65d1f7c service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Received unexpected event network-vif-plugged-799c3fc0-d40b-4411-bd8d-44f080a0eead for instance with vm_state building and task_state spawning.
Nov 07 04:12:37 user nova-compute[74540]: DEBUG nova.compute.manager [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:12:37 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Instance spawned successfully.
Nov 07 04:12:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:12:37 user nova-compute[74540]: INFO nova.compute.manager [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 07 04:12:37 user nova-compute[74540]: DEBUG nova.compute.manager [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:12:37 user nova-compute[74540]: INFO nova.compute.manager [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Took 6.63 seconds to build instance.
Nov 07 04:12:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-75768bb8-a932-4da0-85c0-25a30a9a0af1 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.733s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:37 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:38 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:38 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:38 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 04:12:38 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] There are 0 instances to clean {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 04:12:38 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:38 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74540) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 04:12:40 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:12:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:44 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:12:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:47 user nova-compute[74540]: INFO nova.compute.manager [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Rescuing
Nov 07 04:12:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:12:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquired lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:12:47 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:12:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:12:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:47 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Updating instance_info_cache with network_info: [{"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:12:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Releasing lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:12:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-9b46cee7-ba5e-4cb6-8aff-40234d850e48 req-824f22c5-d531-4c8c-85db-0cfe79bec448 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-unplugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9b46cee7-ba5e-4cb6-8aff-40234d850e48 req-824f22c5-d531-4c8c-85db-0cfe79bec448 service nova] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9b46cee7-ba5e-4cb6-8aff-40234d850e48 req-824f22c5-d531-4c8c-85db-0cfe79bec448 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9b46cee7-ba5e-4cb6-8aff-40234d850e48 req-824f22c5-d531-4c8c-85db-0cfe79bec448 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG nova.compute.manager [req-9b46cee7-ba5e-4cb6-8aff-40234d850e48 req-824f22c5-d531-4c8c-85db-0cfe79bec448 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] No waiting events found dispatching network-vif-unplugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:12:48 user nova-compute[74540]: WARNING nova.compute.manager [req-9b46cee7-ba5e-4cb6-8aff-40234d850e48 req-824f22c5-d531-4c8c-85db-0cfe79bec448 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received unexpected event network-vif-unplugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 for instance with vm_state active and task_state rescuing.
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:48 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Instance destroyed successfully.
Nov 07 04:12:48 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Attempting a stable device rescue
Nov 07 04:12:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74540) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Instance directory exists: not creating {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 04:12:48 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Creating image(s)
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "/opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "/opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:48 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'trusted_certs' on Instance uuid ac4742cd-822a-43b1-adc7-4c7452bd0e35 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "efe2d283e12f6cc2b50f998bfe9e21cada1a9a01" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "efe2d283e12f6cc2b50f998bfe9e21cada1a9a01" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01.part --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 1.058s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:50 user nova-compute[74540]: DEBUG nova.virt.images [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] 0cb3d34f-4da4-43e2-82de-101dfec83536 was qcow2, converting to raw {{(pid=74540) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 04:12:50 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:12:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01.part /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01.converted {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01.part /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01.converted" returned: 0 in 0.829s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.manager [req-c262ce7e-69b3-4bb5-b0dd-62a2ea7e462a req-6c006661-957d-402b-b4b7-05c01d14af77 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c262ce7e-69b3-4bb5-b0dd-62a2ea7e462a req-6c006661-957d-402b-b4b7-05c01d14af77 service nova] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c262ce7e-69b3-4bb5-b0dd-62a2ea7e462a req-6c006661-957d-402b-b4b7-05c01d14af77 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c262ce7e-69b3-4bb5-b0dd-62a2ea7e462a req-6c006661-957d-402b-b4b7-05c01d14af77 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.manager [req-c262ce7e-69b3-4bb5-b0dd-62a2ea7e462a req-6c006661-957d-402b-b4b7-05c01d14af77 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] No waiting events found dispatching network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:12:51 user nova-compute[74540]: WARNING nova.compute.manager [req-c262ce7e-69b3-4bb5-b0dd-62a2ea7e462a req-6c006661-957d-402b-b4b7-05c01d14af77 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received unexpected event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 for instance with vm_state active and task_state rescuing.
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01.converted --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:51 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:12:51 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7672MB free_disk=25.036090850830078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01.converted --force-share --output=json" returned: 0 in 0.249s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "efe2d283e12f6cc2b50f998bfe9e21cada1a9a01" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.384s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "efe2d283e12f6cc2b50f998bfe9e21cada1a9a01" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "efe2d283e12f6cc2b50f998bfe9e21cada1a9a01" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance f146d8c3-a189-49da-84d0-b49dc77e4144 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 20aefb10-e25b-4227-ba94-aaa411050d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 385719ec-63d8-4c6d-a366-92fe921e70a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing inventories for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating ProviderTree inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing aggregate associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, aggregates: None {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01 --force-share --output=json" returned: 0 in 0.227s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01,backing_fmt=raw /opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/disk.rescue {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing trait associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01,backing_fmt=raw /opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/disk.rescue" returned: 0 in 0.084s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "efe2d283e12f6cc2b50f998bfe9e21cada1a9a01" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'migration_context' on Instance uuid ac4742cd-822a-43b1-adc7-4c7452bd0e35 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laFEtszr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:12:51 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:12:51 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:12:51 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.objects.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Object Instance<ac4742cd-822a-43b1-adc7-4c7452bd0e35> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Start _get_guest_xml network_info=[{"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "vif_mac": "fa:16:3e:0e:58:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0cb3d34f-4da4-43e2-82de-101dfec83536', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVHNEMTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ac4742cd-822a-43b1-adc7-4c7452bd0e35', 'attached_at': '', 'detached_at': '', 'volume_id': '35a7a6dd-6cc6-4528-b0fd-172e6a6b5527', 'serial': '35a7a6dd-6cc6-4528-b0fd-172e6a6b5527'}, 'boot_index': 0, 'attachment_id': 'dbf242e7-9c6f-458b-a8d4-852357850929', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'resources' on Instance uuid ac4742cd-822a-43b1-adc7-4c7452bd0e35 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[13993fe5-fef9-4275-b918-8bbec777879b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:12:51 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.objects.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Object Instance<ac4742cd-822a-43b1-adc7-4c7452bd0e35> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'numa_topology' on Instance uuid ac4742cd-822a-43b1-adc7-4c7452bd0e35 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.objects.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Object Instance<ac4742cd-822a-43b1-adc7-4c7452bd0e35> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:51 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:12:51 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ee4ef3-522b-48b6-900f-4c7af5643b94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c] added
Nov 07 04:12:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'vcpu_model' on Instance uuid ac4742cd-822a-43b1-adc7-4c7452bd0e35 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f406a5-80cd-41ff-a972-34c24c46ede0]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.objects.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Object Instance<ac4742cd-822a-43b1-adc7-4c7452bd0e35> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVHNEMTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:12:51 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46250c9-8690-40c4-88b8-c1fa55ef8945]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v laFEtszr {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v laFEtszr" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9917e7bf-ca9b-4992-80d0-62d2567ea4bd]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'laFEtszr'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[66454958-87d9-4cc0-bf03-3b728fae9140]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[12217d75-49ee-4082-be31-e82b259568b8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:12:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:12:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:12:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4652a6-61a6-4518-9884-eb7062121085]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c, portal: 172.16.0.220,3260]
Nov 07 04:12:52 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c, portal: 172.16.0.220,3260] successful.
Nov 07 04:12:52 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43b4103-c991-447c-be2e-230947c0e335]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3eb661-c95a-48a9-b2fb-0d10fc34aac4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:12:52 user nova-compute[74540]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)
Nov 07 04:12:52 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:12:52 user nova-compute[74540]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)
Nov 07 04:12:52 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.944s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1151c615-1139-4103-996d-33eb3cbece6d]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:12:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laFEtszr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23237623039313430', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237623039313430', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.274s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:12:53 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:12:53 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.objects.instance [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lazy-loading 'flavor' on Instance uuid 20aefb10-e25b-4227-ba94-aaa411050d80 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac35497-68d2-41f9-9da6-12574d935602]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = sVHNEMTU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 07 04:12:53 user nova-compute[74540]: node.name = iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:12:53 user nova-compute[74540]: node.tpgt = -1
Nov 07 04:12:53 user nova-compute[74540]: node.startup = automatic
Nov 07 04:12:53 user nova-compute[74540]: node.leading_login = No
Nov 07 04:12:53 user nova-compute[74540]: iface.iscsi_ifacename = default
Nov 07 04:12:53 user nova-compute[74540]: iface.net_ifacename = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.ipaddress = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.prefix_len = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.hwaddress = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.transport_name = tcp
Nov 07 04:12:53 user nova-compute[74540]: iface.initiatorname = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.state = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.vlan_id = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.vlan_priority = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.vlan_state = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.iface_num = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.mtu = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.port = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.bootproto = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.subnet_mask = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.gateway = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.dhcp_alt_client_id_state = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.dhcp_alt_client_id = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.dhcp_dns = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.dhcp_learn_iqn = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.dhcp_req_vendor_id_state = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.dhcp_vendor_id_state = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.dhcp_vendor_id = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.dhcp_slp_da = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.fragmentation = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.gratuitous_arp = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.incoming_forwarding = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.tos_state = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.tos = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.ttl = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.delayed_ack = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.tcp_nagle = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.tcp_wsf_state = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.tcp_wsf = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.tcp_timer_scale = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.tcp_timestamp = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.redirect = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.def_task_mgmt_timeout = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.header_digest = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.data_digest = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.immediate_data = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.initial_r2t = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.data_seq_inorder = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.data_pdu_inorder = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.erl = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.max_receive_data_len = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.first_burst_len = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.max_outstanding_r2t = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.max_burst_len = 0
Nov 07 04:12:53 user nova-compute[74540]: iface.chap_auth = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.bidi_chap = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.strict_login_compliance = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.discovery_auth = <empty>
Nov 07 04:12:53 user nova-compute[74540]: iface.discovery_logout = <empty>
Nov 07 04:12:53 user nova-compute[74540]: node.discovery_address = <empty>
Nov 07 04:12:53 user nova-compute[74540]: node.discovery_port = 0
Nov 07 04:12:53 user nova-compute[74540]: node.discovery_type = static
Nov 07 04:12:53 user nova-compute[74540]: node.session.initial_cmdsn = 0
Nov 07 04:12:53 user nova-compute[74540]: node.session.initial_login_retry_max = 8
Nov 07 04:12:53 user nova-compute[74540]: node.session.xmit_thread_priority = -20
Nov 07 04:12:53 user nova-compute[74540]: node.session.cmds_max = 128
Nov 07 04:12:53 user nova-compute[74540]: node.session.queue_depth = 32
Nov 07 04:12:53 user nova-compute[74540]: node.session.nr_sessions = 1
Nov 07 04:12:53 user nova-compute[74540]: node.session.auth.authmethod = CHAP
Nov 07 04:12:53 user nova-compute[74540]: node.session.auth.username = sVHNEMTU
Nov 07 04:12:53 user nova-compute[74540]: node.session.auth.password = ***
Nov 07 04:12:53 user nova-compute[74540]: node.session.auth.username_in = <empty>
Nov 07 04:12:53 user nova-compute[74540]: node.session.auth.password_in = <empty>
Nov 07 04:12:53 user nova-compute[74540]: node.session.auth.chap_algs = MD5
Nov 07 04:12:53 user nova-compute[74540]: node.session.timeo.replacement_timeout = 120
Nov 07 04:12:53 user nova-compute[74540]: node.session.err_timeo.abort_timeout = 15
Nov 07 04:12:53 user nova-compute[74540]: node.session.err_timeo.lu_reset_timeout = 30
Nov 07 04:12:53 user nova-compute[74540]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 07 04:12:53 user nova-compute[74540]: node.session.err_timeo.host_reset_timeout = 60
Nov 07 04:12:53 user nova-compute[74540]: node.session.iscsi.FastAbort = Yes
Nov 07 04:12:53 user nova-compute[74540]: node.session.iscsi.InitialR2T = No
Nov 07 04:12:53 user nova-compute[74540]: node.session.iscsi.ImmediateData = Yes
Nov 07 04:12:53 user nova-compute[74540]: node.session.iscsi.FirstBurstLength = 262144
Nov 07 04:12:53 user nova-compute[74540]: node.session.iscsi.MaxBurstLength = 16776192
Nov 07 04:12:53 user nova-compute[74540]: node.session.iscsi.DefaultTime2Retain = 0
Nov 07 04:12:53 user nova-compute[74540]: node.session.iscsi.DefaultTime2Wait = 2
Nov 07 04:12:53 user nova-compute[74540]: node.session.iscsi.MaxConnections = 1
Nov 07 04:12:53 user nova-compute[74540]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 07 04:12:53 user nova-compute[74540]: node.session.iscsi.ERL = 0
Nov 07 04:12:53 user nova-compute[74540]: node.session.scan = manual
Nov 07 04:12:53 user nova-compute[74540]: node.session.reopen_max = 0
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].address = 172.16.0.220
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].port = 3260
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].startup = manual
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].tcp.window_size = 524288
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].tcp.type_of_service = 0
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].timeo.logout_timeout = 15
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].timeo.login_timeout = 15
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].timeo.auth_timeout = 45
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].timeo.noop_out_interval = 5
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].timeo.noop_out_timeout = 5
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].iscsi.HeaderDigest = None
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].iscsi.DataDigest = None
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].iscsi.IFMarker = No
Nov 07 04:12:53 user nova-compute[74540]: node.conn[0].iscsi.OFMarker = No
Nov 07 04:12:53 user nova-compute[74540]: # END RECORD
Nov 07 04:12:53 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:12:53 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:12:53 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:12:53 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:12:53 user nova-compute[74540]:   <serial>d4880b4b-db43-41a1-8181-c3fb93f5a79c</serial>
Nov 07 04:12:53 user nova-compute[74540]: </disk>
Nov 07 04:12:53 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0091971e-5e01-4af4-b2c5-9551f3cc1708]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[147b211f-588a-49f4-96d5-123a769fbe7b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVHNEMTU {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVHNEMTU" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5c31ae-8a58-457d-b034-619143fdc73b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sVHNEMTU'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c49def-2cac-41d5-879e-33065805f572]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6c1221-089b-4ad7-a6dd-56ad0ef404cc]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:12:53 user nova-compute[74540]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)
Nov 07 04:12:53 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:12:53 user nova-compute[74540]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)
Nov 07 04:12:53 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.142s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] HCTL ('33', '0', '0', 0) found on session 32 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[779c12a2-ad04-4d2b-a517-7ec147083308]: (4, ('0 0 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching for a device in session 32 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVHNEMTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.165s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23336643137303431', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336643137303431', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-183391627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-183391627',id=27,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:11:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-yoku2v0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:11:38Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=ac4742cd-822a-43b1-adc7-4c7452bd0e35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "vif_mac": "fa:16:3e:0e:58:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "vif_mac": "fa:16:3e:0e:58:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:58:23,bridge_name='br-int',has_traffic_filtering=True,id=d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cbc02f-e0') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'pci_devices' on Instance uuid ac4742cd-822a-43b1-adc7-4c7452bd0e35 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.objects.base [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Object Instance<ac4742cd-822a-43b1-adc7-4c7452bd0e35> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:12:53 user nova-compute[74540]:   <uuid>ac4742cd-822a-43b1-adc7-4c7452bd0e35</uuid>
Nov 07 04:12:53 user nova-compute[74540]:   <name>instance-0000001b</name>
Nov 07 04:12:53 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:12:53 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:12:53 user nova-compute[74540]:   <metadata>
Nov 07 04:12:53 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:12:53 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:12:53 user nova-compute[74540]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-183391627</nova:name>
Nov 07 04:12:53 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:12:51</nova:creationTime>
Nov 07 04:12:53 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:12:53 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:12:53 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:12:53 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:12:53 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:12:53 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:12:53 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:12:53 user nova-compute[74540]:       <nova:owner>
Nov 07 04:12:53 user nova-compute[74540]:         <nova:user uuid="99ba0f9acca84cdb8cf90c4b313e1b7c">tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member</nova:user>
Nov 07 04:12:53 user nova-compute[74540]:         <nova:project uuid="438cd05cbdb34608940422562ba150c8">tempest-ServerBootFromVolumeStableRescueTest-1329597446</nova:project>
Nov 07 04:12:53 user nova-compute[74540]:       </nova:owner>
Nov 07 04:12:53 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:12:53 user nova-compute[74540]:       <nova:ports>
Nov 07 04:12:53 user nova-compute[74540]:         <nova:port uuid="d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22">
Nov 07 04:12:53 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 04:12:53 user nova-compute[74540]:         </nova:port>
Nov 07 04:12:53 user nova-compute[74540]:       </nova:ports>
Nov 07 04:12:53 user nova-compute[74540]:     </nova:instance>
Nov 07 04:12:53 user nova-compute[74540]:   </metadata>
Nov 07 04:12:53 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:12:53 user nova-compute[74540]:     <system>
Nov 07 04:12:53 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:12:53 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:12:53 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:12:53 user nova-compute[74540]:       <entry name="serial">ac4742cd-822a-43b1-adc7-4c7452bd0e35</entry>
Nov 07 04:12:53 user nova-compute[74540]:       <entry name="uuid">ac4742cd-822a-43b1-adc7-4c7452bd0e35</entry>
Nov 07 04:12:53 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:12:53 user nova-compute[74540]:     </system>
Nov 07 04:12:53 user nova-compute[74540]:   </sysinfo>
Nov 07 04:12:53 user nova-compute[74540]:   <os>
Nov 07 04:12:53 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:12:53 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:12:53 user nova-compute[74540]:   </os>
Nov 07 04:12:53 user nova-compute[74540]:   <features>
Nov 07 04:12:53 user nova-compute[74540]:     <acpi/>
Nov 07 04:12:53 user nova-compute[74540]:     <apic/>
Nov 07 04:12:53 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:12:53 user nova-compute[74540]:   </features>
Nov 07 04:12:53 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:12:53 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:12:53 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:12:53 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:12:53 user nova-compute[74540]:   </clock>
Nov 07 04:12:53 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:12:53 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:12:53 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:12:53 user nova-compute[74540]:   </cpu>
Nov 07 04:12:53 user nova-compute[74540]:   <devices>
Nov 07 04:12:53 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:12:53 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:12:53 user nova-compute[74540]:       <source dev="/dev/sdb"/>
Nov 07 04:12:53 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:12:53 user nova-compute[74540]:       <serial>35a7a6dd-6cc6-4528-b0fd-172e6a6b5527</serial>
Nov 07 04:12:53 user nova-compute[74540]:     </disk>
Nov 07 04:12:53 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:12:53 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:12:53 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/disk.rescue"/>
Nov 07 04:12:53 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 04:12:53 user nova-compute[74540]:       <boot order="1"/>
Nov 07 04:12:53 user nova-compute[74540]:     </disk>
Nov 07 04:12:53 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:12:53 user nova-compute[74540]:       <mac address="fa:16:3e:0e:58:23"/>
Nov 07 04:12:53 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:12:53 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:12:53 user nova-compute[74540]:       <target dev="tapd0cbc02f-e0"/>
Nov 07 04:12:53 user nova-compute[74540]:     </interface>
Nov 07 04:12:53 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:12:53 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/console.log" append="off"/>
Nov 07 04:12:53 user nova-compute[74540]:     </serial>
Nov 07 04:12:53 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:12:53 user nova-compute[74540]:     <video>
Nov 07 04:12:53 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:12:53 user nova-compute[74540]:     </video>
Nov 07 04:12:53 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:12:53 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:12:53 user nova-compute[74540]:     </rng>
Nov 07 04:12:53 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:12:53 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:12:53 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:12:53 user nova-compute[74540]:     </memballoon>
Nov 07 04:12:53 user nova-compute[74540]:   </devices>
Nov 07 04:12:53 user nova-compute[74540]: </domain>
Nov 07 04:12:53 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:12:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Instance destroyed successfully.
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No VIF found with MAC fa:16:3e:0e:58:23, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] No VIF found with MAC fa:16:3e:ea:cb:59, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:12:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-305172bb-7ded-412d-a4f1-f21aab3a2ae7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "20aefb10-e25b-4227-ba94-aaa411050d80" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.579s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updating instance_info_cache with network_info: [{"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-43b92eb7-974b-4110-8026-66c233496e0c req-6b70e004-b9a8-4052-a4c1-919dcf0e3069 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-43b92eb7-974b-4110-8026-66c233496e0c req-6b70e004-b9a8-4052-a4c1-919dcf0e3069 service nova] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-43b92eb7-974b-4110-8026-66c233496e0c req-6b70e004-b9a8-4052-a4c1-919dcf0e3069 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-43b92eb7-974b-4110-8026-66c233496e0c req-6b70e004-b9a8-4052-a4c1-919dcf0e3069 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-43b92eb7-974b-4110-8026-66c233496e0c req-6b70e004-b9a8-4052-a4c1-919dcf0e3069 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] No waiting events found dispatching network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:12:55 user nova-compute[74540]: WARNING nova.compute.manager [req-43b92eb7-974b-4110-8026-66c233496e0c req-6b70e004-b9a8-4052-a4c1-919dcf0e3069 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received unexpected event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 for instance with vm_state active and task_state rescuing.
Nov 07 04:12:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid f146d8c3-a189-49da-84d0-b49dc77e4144 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 9c425dfc-962a-4d21-ba9b-110fed764c51 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid bb6c2f59-c949-4df8-a6e4-ed92d7926639 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 20aefb10-e25b-4227-ba94-aaa411050d80 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid ac4742cd-822a-43b1-adc7-4c7452bd0e35 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid cc15c8fc-e47f-4df0-94ec-8daeacb112c9 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 385719ec-63d8-4c6d-a366-92fe921e70a6 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "9c425dfc-962a-4d21-ba9b-110fed764c51" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "20aefb10-e25b-4227-ba94-aaa411050d80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "20aefb10-e25b-4227-ba94-aaa411050d80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:55 user nova-compute[74540]: INFO nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] During sync_power_state the instance has a pending task (rescuing). Skip.
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "385719ec-63d8-4c6d-a366-92fe921e70a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "20aefb10-e25b-4227-ba94-aaa411050d80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:57 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4cca93cb-7b22-46d1-8d34-db504fcde292 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:12:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-4527b6b8-53cb-4f80-9c99-6888049d5778 req-60d8ddf1-b3a4-4226-9141-bfba984e3423 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4527b6b8-53cb-4f80-9c99-6888049d5778 req-60d8ddf1-b3a4-4226-9141-bfba984e3423 service nova] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:12:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4527b6b8-53cb-4f80-9c99-6888049d5778 req-60d8ddf1-b3a4-4226-9141-bfba984e3423 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:12:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4527b6b8-53cb-4f80-9c99-6888049d5778 req-60d8ddf1-b3a4-4226-9141-bfba984e3423 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:12:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-4527b6b8-53cb-4f80-9c99-6888049d5778 req-60d8ddf1-b3a4-4226-9141-bfba984e3423 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] No waiting events found dispatching network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:12:57 user nova-compute[74540]: WARNING nova.compute.manager [req-4527b6b8-53cb-4f80-9c99-6888049d5778 req-60d8ddf1-b3a4-4226-9141-bfba984e3423 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received unexpected event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 for instance with vm_state active and task_state rescuing.
Nov 07 04:12:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:12:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-fd0928a4-6eb8-44bf-aa2e-0ace0aae95fb req-5a3c2550-f1d3-4e3f-b259-23c1f1432661 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-changed-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:12:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-fd0928a4-6eb8-44bf-aa2e-0ace0aae95fb req-5a3c2550-f1d3-4e3f-b259-23c1f1432661 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Refreshing instance network info cache due to event network-changed-f06d373b-0587-4432-9c3b-8da8b7a99dac. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:12:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fd0928a4-6eb8-44bf-aa2e-0ace0aae95fb req-5a3c2550-f1d3-4e3f-b259-23c1f1432661 service nova] Acquiring lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:12:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fd0928a4-6eb8-44bf-aa2e-0ace0aae95fb req-5a3c2550-f1d3-4e3f-b259-23c1f1432661 service nova] Acquired lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:12:59 user nova-compute[74540]: DEBUG nova.network.neutron [req-fd0928a4-6eb8-44bf-aa2e-0ace0aae95fb req-5a3c2550-f1d3-4e3f-b259-23c1f1432661 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Refreshing network info cache for port f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:12:59 user nova-compute[74540]: DEBUG nova.network.neutron [req-fd0928a4-6eb8-44bf-aa2e-0ace0aae95fb req-5a3c2550-f1d3-4e3f-b259-23c1f1432661 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updated VIF entry in instance network info cache for port f06d373b-0587-4432-9c3b-8da8b7a99dac. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:12:59 user nova-compute[74540]: DEBUG nova.network.neutron [req-fd0928a4-6eb8-44bf-aa2e-0ace0aae95fb req-5a3c2550-f1d3-4e3f-b259-23c1f1432661 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updating instance_info_cache with network_info: [{"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:12:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fd0928a4-6eb8-44bf-aa2e-0ace0aae95fb req-5a3c2550-f1d3-4e3f-b259-23c1f1432661 service nova] Releasing lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:12:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:06 user nova-compute[74540]: INFO nova.compute.manager [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Shelving
Nov 07 04:13:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-b77be7bf-d7e3-4aed-9819-f6e2d8c0711b req-a0a7e376-21f3-4da3-803a-f8ba4fbdacf9 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-vif-unplugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:13:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b77be7bf-d7e3-4aed-9819-f6e2d8c0711b req-a0a7e376-21f3-4da3-803a-f8ba4fbdacf9 service nova] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b77be7bf-d7e3-4aed-9819-f6e2d8c0711b req-a0a7e376-21f3-4da3-803a-f8ba4fbdacf9 service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b77be7bf-d7e3-4aed-9819-f6e2d8c0711b req-a0a7e376-21f3-4da3-803a-f8ba4fbdacf9 service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-b77be7bf-d7e3-4aed-9819-f6e2d8c0711b req-a0a7e376-21f3-4da3-803a-f8ba4fbdacf9 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] No waiting events found dispatching network-vif-unplugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:13:06 user nova-compute[74540]: WARNING nova.compute.manager [req-b77be7bf-d7e3-4aed-9819-f6e2d8c0711b req-a0a7e376-21f3-4da3-803a-f8ba4fbdacf9 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received unexpected event network-vif-unplugged-f06d373b-0587-4432-9c3b-8da8b7a99dac for instance with vm_state active and task_state shelving.
Nov 07 04:13:07 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Instance destroyed successfully.
Nov 07 04:13:07 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Beginning cold snapshot process
Nov 07 04:13:07 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:13:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk /opt/stack/data/nova/instances/snapshots/tmpz0ouk406/06739e3d7cca4cdeb6486a70ba92b662 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk /opt/stack/data/nova/instances/snapshots/tmpz0ouk406/06739e3d7cca4cdeb6486a70ba92b662" returned: 0 in 0.670s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:08 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Snapshot extracted, beginning image upload
Nov 07 04:13:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-d42ee181-0f67-4284-9ce3-3e93b45f2827 req-14080541-d6f4-4a42-a747-e3bd771be969 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:13:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d42ee181-0f67-4284-9ce3-3e93b45f2827 req-14080541-d6f4-4a42-a747-e3bd771be969 service nova] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d42ee181-0f67-4284-9ce3-3e93b45f2827 req-14080541-d6f4-4a42-a747-e3bd771be969 service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d42ee181-0f67-4284-9ce3-3e93b45f2827 req-14080541-d6f4-4a42-a747-e3bd771be969 service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-d42ee181-0f67-4284-9ce3-3e93b45f2827 req-14080541-d6f4-4a42-a747-e3bd771be969 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] No waiting events found dispatching network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:13:08 user nova-compute[74540]: WARNING nova.compute.manager [req-d42ee181-0f67-4284-9ce3-3e93b45f2827 req-14080541-d6f4-4a42-a747-e3bd771be969 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received unexpected event network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac for instance with vm_state active and task_state shelving_image_uploading.
Nov 07 04:13:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:11 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Snapshot image upload complete
Nov 07 04:13:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:13:11 user nova-compute[74540]: INFO nova.compute.manager [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Shelve offloading
Nov 07 04:13:11 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Instance destroyed successfully.
Nov 07 04:13:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:13:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:13:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquired lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:13:11 user nova-compute[74540]: DEBUG nova.network.neutron [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:13:11 user nova-compute[74540]: DEBUG nova.network.neutron [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updating instance_info_cache with network_info: [{"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:13:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Releasing lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:13:12 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Instance destroyed successfully.
Nov 07 04:13:12 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'resources' on Instance uuid dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746250716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746250716',id=28,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNChMQCLEy9+WuUP39ksN9q/qa3TqLb45LKZcHylN1OOkc1rkBz3INROxl/WpAAfTfI2AGIrUFbN9SI7GkWRLRakALvOyCI3Nz/jruNUIhLg9I+QxWS7piL60Vr0FmneGg==',key_name='tempest-keypair-24688172',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='796865203135404b8624363d533ae6fe',ramdisk_id='',reservation_id='r-oora9sqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952443794',owner_user_name='tempest-AttachVolumeShelveTestJSON-952443794-project-member',shelved_at='2023-11-07T04:13:11.259893',shelved_host='user',shelved_image_id='cc2c7051-2332-48e3-bd59-f83096f7ad92'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fad238078941dba4cc57406b1c69ed',uuid=dc24a0b7-ff3c-482c-b0c5-0dcd70dda367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converting VIF {"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG os_vif [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf06d373b-05, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6995eae2-01c8-41ac-b88c-f9b64f776510) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:13:12 user nova-compute[74540]: INFO os_vif [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05')
Nov 07 04:13:12 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Deleting instance files /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367_del
Nov 07 04:13:12 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Deletion of /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367_del complete
Nov 07 04:13:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-3c3c51e1-6a23-4c16-b51a-f95c455855c4 req-16e0578d-4184-4b45-b8e9-d3bbcaa843b8 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-changed-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-3c3c51e1-6a23-4c16-b51a-f95c455855c4 req-16e0578d-4184-4b45-b8e9-d3bbcaa843b8 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Refreshing instance network info cache due to event network-changed-f06d373b-0587-4432-9c3b-8da8b7a99dac. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3c3c51e1-6a23-4c16-b51a-f95c455855c4 req-16e0578d-4184-4b45-b8e9-d3bbcaa843b8 service nova] Acquiring lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3c3c51e1-6a23-4c16-b51a-f95c455855c4 req-16e0578d-4184-4b45-b8e9-d3bbcaa843b8 service nova] Acquired lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:13:12 user nova-compute[74540]: DEBUG nova.network.neutron [req-3c3c51e1-6a23-4c16-b51a-f95c455855c4 req-16e0578d-4184-4b45-b8e9-d3bbcaa843b8 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Refreshing network info cache for port f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:13:12 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Deleted allocations for instance dc24a0b7-ff3c-482c-b0c5-0dcd70dda367
Nov 07 04:13:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:13 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'numa_topology' on Instance uuid dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:13:13 user nova-compute[74540]: DEBUG nova.objects.base [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Object Instance<dc24a0b7-ff3c-482c-b0c5-0dcd70dda367> lazy-loaded attributes: resources,numa_topology {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:13:13 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:13:13 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:13:13 user nova-compute[74540]: DEBUG nova.network.neutron [req-3c3c51e1-6a23-4c16-b51a-f95c455855c4 req-16e0578d-4184-4b45-b8e9-d3bbcaa843b8 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updated VIF entry in instance network info cache for port f06d373b-0587-4432-9c3b-8da8b7a99dac. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:13:13 user nova-compute[74540]: DEBUG nova.network.neutron [req-3c3c51e1-6a23-4c16-b51a-f95c455855c4 req-16e0578d-4184-4b45-b8e9-d3bbcaa843b8 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updating instance_info_cache with network_info: [{"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf06d373b-05", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:13:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3c3c51e1-6a23-4c16-b51a-f95c455855c4 req-16e0578d-4184-4b45-b8e9-d3bbcaa843b8 service nova] Releasing lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:13:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d3f6cc5d-e7ab-45c8-b94a-8a6d3eeaf89c tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.124s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:24 user nova-compute[74540]: INFO nova.compute.manager [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Terminating instance
Nov 07 04:13:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-d85e33bd-6a04-4379-b43c-38e20afc016b req-18296c74-54cc-41fc-a5da-bf78698a7552 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received event network-vif-unplugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d85e33bd-6a04-4379-b43c-38e20afc016b req-18296c74-54cc-41fc-a5da-bf78698a7552 service nova] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d85e33bd-6a04-4379-b43c-38e20afc016b req-18296c74-54cc-41fc-a5da-bf78698a7552 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d85e33bd-6a04-4379-b43c-38e20afc016b req-18296c74-54cc-41fc-a5da-bf78698a7552 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-d85e33bd-6a04-4379-b43c-38e20afc016b req-18296c74-54cc-41fc-a5da-bf78698a7552 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] No waiting events found dispatching network-vif-unplugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-d85e33bd-6a04-4379-b43c-38e20afc016b req-18296c74-54cc-41fc-a5da-bf78698a7552 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received event network-vif-unplugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:25 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Instance destroyed successfully.
Nov 07 04:13:25 user nova-compute[74540]: DEBUG nova.objects.instance [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'resources' on Instance uuid f146d8c3-a189-49da-84d0-b49dc77e4144 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1630826878',display_name='tempest-ServerRescueNegativeTestJSON-server-1630826878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1630826878',id=2,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T03:58:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60a9f3df6bba4675b2332ac4ded5373e',ramdisk_id='',reservation_id='r-dh60fwvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1326022799',owner_user_name='tempest-ServerRescueNegativeTestJSON-1326022799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T03:58:31Z,user_data=None,user_id='c3b660fa816a404196af3027d19aea51',uuid=f146d8c3-a189-49da-84d0-b49dc77e4144,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converting VIF {"id": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "address": "fa:16:3e:9b:b1:e2", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec7cc688-a3", "ovs_interfaceid": "ec7cc688-a3a0-46a3-aa63-6e32ca5bf216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:b1:e2,bridge_name='br-int',has_traffic_filtering=True,id=ec7cc688-a3a0-46a3-aa63-6e32ca5bf216,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7cc688-a3') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG os_vif [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:b1:e2,bridge_name='br-int',has_traffic_filtering=True,id=ec7cc688-a3a0-46a3-aa63-6e32ca5bf216,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7cc688-a3') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec7cc688-a3, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=385d5628-3a62-483c-877f-cb38be372502) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:25 user nova-compute[74540]: INFO os_vif [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:b1:e2,bridge_name='br-int',has_traffic_filtering=True,id=ec7cc688-a3a0-46a3-aa63-6e32ca5bf216,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec7cc688-a3')
Nov 07 04:13:25 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Deleting instance files /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144_del
Nov 07 04:13:25 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Deletion of /opt/stack/data/nova/instances/f146d8c3-a189-49da-84d0-b49dc77e4144_del complete
Nov 07 04:13:25 user nova-compute[74540]: INFO nova.compute.manager [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 07 04:13:25 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:25 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:13:25 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Took 0.51 seconds to deallocate network for instance.
Nov 07 04:13:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:26 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:13:26 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:13:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:26 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Deleted allocations for instance f146d8c3-a189-49da-84d0-b49dc77e4144
Nov 07 04:13:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a1cdc026-1a1c-4b82-b274-5adc3b2a97f9 tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.030s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-889fdf99-1f13-4d43-9557-b43a050ce495 req-5dcc313f-4b63-44be-a98f-6a1beed2e221 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received event network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:13:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-889fdf99-1f13-4d43-9557-b43a050ce495 req-5dcc313f-4b63-44be-a98f-6a1beed2e221 service nova] Acquiring lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-889fdf99-1f13-4d43-9557-b43a050ce495 req-5dcc313f-4b63-44be-a98f-6a1beed2e221 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-889fdf99-1f13-4d43-9557-b43a050ce495 req-5dcc313f-4b63-44be-a98f-6a1beed2e221 service nova] Lock "f146d8c3-a189-49da-84d0-b49dc77e4144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-889fdf99-1f13-4d43-9557-b43a050ce495 req-5dcc313f-4b63-44be-a98f-6a1beed2e221 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] No waiting events found dispatching network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:13:26 user nova-compute[74540]: WARNING nova.compute.manager [req-889fdf99-1f13-4d43-9557-b43a050ce495 req-5dcc313f-4b63-44be-a98f-6a1beed2e221 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received unexpected event network-vif-plugged-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 for instance with vm_state deleted and task_state None.
Nov 07 04:13:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-889fdf99-1f13-4d43-9557-b43a050ce495 req-5dcc313f-4b63-44be-a98f-6a1beed2e221 service nova] [instance: f146d8c3-a189-49da-84d0-b49dc77e4144] Received event network-vif-deleted-ec7cc688-a3a0-46a3-aa63-6e32ca5bf216 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:13:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:13:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:30 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:13:30 user nova-compute[74540]: INFO nova.compute.claims [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Claim successful on node user
Nov 07 04:13:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG nova.network.neutron [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:13:31 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:13:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG nova.policy [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd0ca1c305c04866b3323a98c6796ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e4bbbf680d48fe8534c9ebe909fd50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:13:31 user nova-compute[74540]: INFO nova.virt.block_device [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Booting with volume 4152bc01-2e45-4a4a-898e-67ca9253d5d1 at /dev/vda
Nov 07 04:13:31 user nova-compute[74540]: DEBUG os_brick.utils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aa8a79-ce2e-4dbc-84e7-35d650168715]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b0fea1-2174-46f2-9868-913af4a22a40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ace021-8d48-4a32-a2e3-8eebcad55dd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[292aa5bb-3aa9-4223-8466-5c5b6f417cb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:13:31 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:13:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e027cf-7e02-4ffa-8f36-d26aed186ac2]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG os_brick.utils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:13:31 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updating existing volume attachment record: 91b1ec07-0efe-4e04-9d79-cb90b02463dd {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:13:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Successfully created port: 9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:13:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Successfully updated port: 9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:13:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:13:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquired lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:13:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:13:32 user nova-compute[74540]: DEBUG nova.compute.manager [req-e622f515-3713-47e4-977b-afd05a473f55 req-94e42a9e-19b3-4d80-97c1-564eee41f00f service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received event network-changed-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:13:32 user nova-compute[74540]: DEBUG nova.compute.manager [req-e622f515-3713-47e4-977b-afd05a473f55 req-94e42a9e-19b3-4d80-97c1-564eee41f00f service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Refreshing instance network info cache due to event network-changed-9a1d45ca-93e6-4b48-a819-06ae409b7c89. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:13:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e622f515-3713-47e4-977b-afd05a473f55 req-94e42a9e-19b3-4d80-97c1-564eee41f00f service nova] Acquiring lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:13:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:13:33 user nova-compute[74540]: DEBUG nova.network.neutron [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updating instance_info_cache with network_info: [{"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:13:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Releasing lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:13:33 user nova-compute[74540]: DEBUG nova.compute.manager [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Instance network_info: |[{"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:13:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e622f515-3713-47e4-977b-afd05a473f55 req-94e42a9e-19b3-4d80-97c1-564eee41f00f service nova] Acquired lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:13:33 user nova-compute[74540]: DEBUG nova.network.neutron [req-e622f515-3713-47e4-977b-afd05a473f55 req-94e42a9e-19b3-4d80-97c1-564eee41f00f service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Refreshing network info cache for port 9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:13:33 user nova-compute[74540]: DEBUG nova.network.neutron [req-e622f515-3713-47e4-977b-afd05a473f55 req-94e42a9e-19b3-4d80-97c1-564eee41f00f service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updated VIF entry in instance network info cache for port 9a1d45ca-93e6-4b48-a819-06ae409b7c89. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:13:33 user nova-compute[74540]: DEBUG nova.network.neutron [req-e622f515-3713-47e4-977b-afd05a473f55 req-94e42a9e-19b3-4d80-97c1-564eee41f00f service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updating instance_info_cache with network_info: [{"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:13:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e622f515-3713-47e4-977b-afd05a473f55 req-94e42a9e-19b3-4d80-97c1-564eee41f00f service nova] Releasing lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:13:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:37 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:13:37 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:13:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:40 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:13:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:13:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:13:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:13:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:13:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:45 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:13:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:45 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:13:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:13:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:13:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:49 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:13:49 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:13:49 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7694MB free_disk=24.906341552734375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:13:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 20aefb10-e25b-4227-ba94-aaa411050d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 385719ec-63d8-4c6d-a366-92fe921e70a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bbed18c8-efc2-453e-825c-caf6a686c9cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:13:51 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:13:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:13:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:13:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:13:51 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:13:51 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updating instance_info_cache with network_info: [{"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:13:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:13:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:13:51 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:13:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Creating image(s)
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Ensure instance console log exists: /opt/stack/data/nova/instances/bbed18c8-efc2-453e-825c-caf6a686c9cb/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Start _get_guest_xml network_info=[{"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNIMceKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bbed18c8-efc2-453e-825c-caf6a686c9cb', 'attached_at': '', 'detached_at': '', 'volume_id': '4152bc01-2e45-4a4a-898e-67ca9253d5d1', 'serial': '4152bc01-2e45-4a4a-898e-67ca9253d5d1'}, 'boot_index': 0, 'attachment_id': '91b1ec07-0efe-4e04-9d79-cb90b02463dd', 'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:13:54 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:13:54 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNIMceKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:13:54 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:13:54 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:13:54 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0272eee3-2218-46b1-b45e-1f5e52ac702e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:13:54 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3367e0f2-681e-431d-92a9-3cfcdf3bc9b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1] added
Nov 07 04:13:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb50eaa-f001-4b54-9d9a-432a90e78d36]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7bf7fd-0958-438c-9897-618fb47cdafe]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNIMceKd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNIMceKd" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[558cecba-1d38-4ff9-a874-7ba2c75c9b49]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNIMceKd'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cc6aa6-b8f6-41dd-9e95-8bbfdc6e0538]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d411fbf-4eb2-44e2-932c-e2621b6fe390]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:13:54 user nova-compute[74540]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)
Nov 07 04:13:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:13:54 user nova-compute[74540]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)
Nov 07 04:13:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62fcc2b-cad5-4db1-b620-a93d72bf0f40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260]
Nov 07 04:13:54 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260] successful.
Nov 07 04:13:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6cdffd-b22b-404a-aa6e-b7d9ae1d700b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e15edc1-dc30-4f47-8091-ea9e3cfb4b54]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:13:54 user nova-compute[74540]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)
Nov 07 04:13:54 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:13:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:13:54 user nova-compute[74540]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)
Nov 07 04:13:54 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:13:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b730f0d3-a2b3-4235-aea5-d90c693d77c5]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:13:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNIMceKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23763396633663438', 'path': '/dev/sdd'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763396633663438', 'path': '/dev/sdd'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-209729649',display_name='tempest-ServerActionsTestOtherA-server-209729649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-209729649',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwNZBrKGScuWsQUPfoY0b3AbxyGKSkLExG0cpMUZnRvSTxBRcsFtIZ1RT1pR1+eCQdUJD5DJCUo9GsJbQ2Fmr9SGNPRCHO5qhdeLD9soxcgYrMJdlf2ABhS3l6lT6tLnQ==',key_name='tempest-keypair-987204751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-ovt0rkj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:13:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=bbed18c8-efc2-453e-825c-caf6a686c9cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:13:55 user nova-compute[74540]: DEBUG nova.objects.instance [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lazy-loading 'pci_devices' on Instance uuid bbed18c8-efc2-453e-825c-caf6a686c9cb {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:13:56 user nova-compute[74540]:   <uuid>bbed18c8-efc2-453e-825c-caf6a686c9cb</uuid>
Nov 07 04:13:56 user nova-compute[74540]:   <name>instance-0000001f</name>
Nov 07 04:13:56 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:13:56 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:13:56 user nova-compute[74540]:   <metadata>
Nov 07 04:13:56 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:13:56 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:13:56 user nova-compute[74540]:       <nova:name>tempest-ServerActionsTestOtherA-server-209729649</nova:name>
Nov 07 04:13:56 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:13:54</nova:creationTime>
Nov 07 04:13:56 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:13:56 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:13:56 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:13:56 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:13:56 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:13:56 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:13:56 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:13:56 user nova-compute[74540]:       <nova:owner>
Nov 07 04:13:56 user nova-compute[74540]:         <nova:user uuid="bd0ca1c305c04866b3323a98c6796ded">tempest-ServerActionsTestOtherA-28801548-project-member</nova:user>
Nov 07 04:13:56 user nova-compute[74540]:         <nova:project uuid="04e4bbbf680d48fe8534c9ebe909fd50">tempest-ServerActionsTestOtherA-28801548</nova:project>
Nov 07 04:13:56 user nova-compute[74540]:       </nova:owner>
Nov 07 04:13:56 user nova-compute[74540]:       <nova:ports>
Nov 07 04:13:56 user nova-compute[74540]:         <nova:port uuid="9a1d45ca-93e6-4b48-a819-06ae409b7c89">
Nov 07 04:13:56 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 04:13:56 user nova-compute[74540]:         </nova:port>
Nov 07 04:13:56 user nova-compute[74540]:       </nova:ports>
Nov 07 04:13:56 user nova-compute[74540]:     </nova:instance>
Nov 07 04:13:56 user nova-compute[74540]:   </metadata>
Nov 07 04:13:56 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:13:56 user nova-compute[74540]:     <system>
Nov 07 04:13:56 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:13:56 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:13:56 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:13:56 user nova-compute[74540]:       <entry name="serial">bbed18c8-efc2-453e-825c-caf6a686c9cb</entry>
Nov 07 04:13:56 user nova-compute[74540]:       <entry name="uuid">bbed18c8-efc2-453e-825c-caf6a686c9cb</entry>
Nov 07 04:13:56 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:13:56 user nova-compute[74540]:     </system>
Nov 07 04:13:56 user nova-compute[74540]:   </sysinfo>
Nov 07 04:13:56 user nova-compute[74540]:   <os>
Nov 07 04:13:56 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:13:56 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:13:56 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:13:56 user nova-compute[74540]:   </os>
Nov 07 04:13:56 user nova-compute[74540]:   <features>
Nov 07 04:13:56 user nova-compute[74540]:     <acpi/>
Nov 07 04:13:56 user nova-compute[74540]:     <apic/>
Nov 07 04:13:56 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:13:56 user nova-compute[74540]:   </features>
Nov 07 04:13:56 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:13:56 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:13:56 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:13:56 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:13:56 user nova-compute[74540]:   </clock>
Nov 07 04:13:56 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:13:56 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:13:56 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:13:56 user nova-compute[74540]:   </cpu>
Nov 07 04:13:56 user nova-compute[74540]:   <devices>
Nov 07 04:13:56 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:13:56 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:13:56 user nova-compute[74540]:       <source dev="/dev/sdd"/>
Nov 07 04:13:56 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:13:56 user nova-compute[74540]:       <serial>4152bc01-2e45-4a4a-898e-67ca9253d5d1</serial>
Nov 07 04:13:56 user nova-compute[74540]:     </disk>
Nov 07 04:13:56 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:13:56 user nova-compute[74540]:       <mac address="fa:16:3e:5d:2b:e9"/>
Nov 07 04:13:56 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:13:56 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:13:56 user nova-compute[74540]:       <target dev="tap9a1d45ca-93"/>
Nov 07 04:13:56 user nova-compute[74540]:     </interface>
Nov 07 04:13:56 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:13:56 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/bbed18c8-efc2-453e-825c-caf6a686c9cb/console.log" append="off"/>
Nov 07 04:13:56 user nova-compute[74540]:     </serial>
Nov 07 04:13:56 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:13:56 user nova-compute[74540]:     <video>
Nov 07 04:13:56 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:13:56 user nova-compute[74540]:     </video>
Nov 07 04:13:56 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:13:56 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:13:56 user nova-compute[74540]:     </rng>
Nov 07 04:13:56 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:13:56 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:13:56 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:13:56 user nova-compute[74540]:     </memballoon>
Nov 07 04:13:56 user nova-compute[74540]:   </devices>
Nov 07 04:13:56 user nova-compute[74540]: </domain>
Nov 07 04:13:56 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-209729649',display_name='tempest-ServerActionsTestOtherA-server-209729649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-209729649',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwNZBrKGScuWsQUPfoY0b3AbxyGKSkLExG0cpMUZnRvSTxBRcsFtIZ1RT1pR1+eCQdUJD5DJCUo9GsJbQ2Fmr9SGNPRCHO5qhdeLD9soxcgYrMJdlf2ABhS3l6lT6tLnQ==',key_name='tempest-keypair-987204751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-ovt0rkj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:13:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=bbed18c8-efc2-453e-825c-caf6a686c9cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG os_vif [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fcac2f3-a30d-5436-b35b-570382c05f37', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a1d45ca-93, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a1d45ca-93, col_values=(('qos', UUID('1e46848c-dcc6-465b-ac72-2d039c48f9fb')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a1d45ca-93, col_values=(('external_ids', {'iface-id': '9a1d45ca-93e6-4b48-a819-06ae409b7c89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:2b:e9', 'vm-uuid': 'bbed18c8-efc2-453e-825c-caf6a686c9cb'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:56 user nova-compute[74540]: INFO os_vif [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93')
Nov 07 04:13:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:13:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No VIF found with MAC fa:16:3e:5d:2b:e9, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:13:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-5600585f-7def-4d11-b322-f9acdab78b2a req-8f451274-9273-4870-9873-8f163d3ab820 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received event network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:13:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5600585f-7def-4d11-b322-f9acdab78b2a req-8f451274-9273-4870-9873-8f163d3ab820 service nova] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5600585f-7def-4d11-b322-f9acdab78b2a req-8f451274-9273-4870-9873-8f163d3ab820 service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5600585f-7def-4d11-b322-f9acdab78b2a req-8f451274-9273-4870-9873-8f163d3ab820 service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-5600585f-7def-4d11-b322-f9acdab78b2a req-8f451274-9273-4870-9873-8f163d3ab820 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] No waiting events found dispatching network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:13:57 user nova-compute[74540]: WARNING nova.compute.manager [req-5600585f-7def-4d11-b322-f9acdab78b2a req-8f451274-9273-4870-9873-8f163d3ab820 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received unexpected event network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 for instance with vm_state building and task_state spawning.
Nov 07 04:13:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG nova.compute.manager [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:13:59 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Instance spawned successfully.
Nov 07 04:13:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:13:59 user nova-compute[74540]: INFO nova.compute.manager [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 07 04:13:59 user nova-compute[74540]: DEBUG nova.compute.manager [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-e9045447-06e2-44db-aa73-d0e6fe3daa58 req-fb8a4026-9fba-464d-8246-6c3d432ccd67 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received event network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e9045447-06e2-44db-aa73-d0e6fe3daa58 req-fb8a4026-9fba-464d-8246-6c3d432ccd67 service nova] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e9045447-06e2-44db-aa73-d0e6fe3daa58 req-fb8a4026-9fba-464d-8246-6c3d432ccd67 service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e9045447-06e2-44db-aa73-d0e6fe3daa58 req-fb8a4026-9fba-464d-8246-6c3d432ccd67 service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:13:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-e9045447-06e2-44db-aa73-d0e6fe3daa58 req-fb8a4026-9fba-464d-8246-6c3d432ccd67 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] No waiting events found dispatching network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:13:59 user nova-compute[74540]: WARNING nova.compute.manager [req-e9045447-06e2-44db-aa73-d0e6fe3daa58 req-fb8a4026-9fba-464d-8246-6c3d432ccd67 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received unexpected event network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 for instance with vm_state building and task_state spawning.
Nov 07 04:13:59 user nova-compute[74540]: INFO nova.compute.manager [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Took 29.18 seconds to build instance.
Nov 07 04:13:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-89549b27-177e-4ccb-a974-35b9cc757441 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.278s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "20aefb10-e25b-4227-ba94-aaa411050d80" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "20aefb10-e25b-4227-ba94-aaa411050d80" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:06 user nova-compute[74540]: INFO nova.compute.manager [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Detaching volume d4880b4b-db43-41a1-8181-c3fb93f5a79c
Nov 07 04:14:06 user nova-compute[74540]: INFO nova.virt.block_device [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Attempting to driver detach volume d4880b4b-db43-41a1-8181-c3fb93f5a79c from mountpoint /dev/vdb
Nov 07 04:14:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:06 user nova-compute[74540]: INFO nova.compute.manager [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Terminating instance
Nov 07 04:14:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Attempting to detach device vdb from instance 20aefb10-e25b-4227-ba94-aaa411050d80 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:14:06 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:14:06 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:14:06 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:14:06 user nova-compute[74540]:   <serial>d4880b4b-db43-41a1-8181-c3fb93f5a79c</serial>
Nov 07 04:14:06 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:14:06 user nova-compute[74540]: </disk>
Nov 07 04:14:06 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:14:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Successfully detached device vdb from instance 20aefb10-e25b-4227-ba94-aaa411050d80 from the persistent domain config.
Nov 07 04:14:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20aefb10-e25b-4227-ba94-aaa411050d80 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:14:06 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:14:06 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:14:06 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:14:06 user nova-compute[74540]:   <serial>d4880b4b-db43-41a1-8181-c3fb93f5a79c</serial>
Nov 07 04:14:06 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:14:06 user nova-compute[74540]: </disk>
Nov 07 04:14:06 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "20aefb10-e25b-4227-ba94-aaa411050d80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-dfbf3cd3-6667-40cb-b19e-55d1d9a1ae38 req-c683da9e-2d23-4a44-9e03-ba5b0a03626f service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-unplugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dfbf3cd3-6667-40cb-b19e-55d1d9a1ae38 req-c683da9e-2d23-4a44-9e03-ba5b0a03626f service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dfbf3cd3-6667-40cb-b19e-55d1d9a1ae38 req-c683da9e-2d23-4a44-9e03-ba5b0a03626f service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dfbf3cd3-6667-40cb-b19e-55d1d9a1ae38 req-c683da9e-2d23-4a44-9e03-ba5b0a03626f service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-dfbf3cd3-6667-40cb-b19e-55d1d9a1ae38 req-c683da9e-2d23-4a44-9e03-ba5b0a03626f service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-unplugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-dfbf3cd3-6667-40cb-b19e-55d1d9a1ae38 req-c683da9e-2d23-4a44-9e03-ba5b0a03626f service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-unplugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:14:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20aefb10-e25b-4227-ba94-aaa411050d80 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Instance destroyed successfully.
Nov 07 04:14:07 user nova-compute[74540]: DEBUG nova.objects.instance [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'resources' on Instance uuid 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1911941987',display_name='tempest-AttachVolumeTestJSON-server-1911941987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1911941987',id=18,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZc0H8u9Sjs7UCPrYgQ/YYzLFW938ISChSSmxmxSC0YJVGNn+t+64OY9nQmYmr4BRKTp4XCwtT9CfL/C0bBD3MbQluNfqx9UtboWoTJuQ/vtZlZuy9FmbFmNS0Ski8AxQ==',key_name='tempest-keypair-1685201050',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513e7858a1b34aa2bd5f363696b38f0a',ramdisk_id='',reservation_id='r-3y9w8i3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-540287196',owner_user_name='tempest-AttachVolumeTestJSON-540287196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='791771e33e0645d6b97cef52f84d8b9c',uuid=80624b0b-4c6b-4d6f-9d31-2f7c81e39c79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converting VIF {"id": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "address": "fa:16:3e:53:d9:ef", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap134a19cd-7f", "ovs_interfaceid": "134a19cd-7f72-44e1-82c0-5ffab04d98b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG os_vif [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap134a19cd-7f, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eabb7553-ba06-4ea9-8dbe-781a91e1bd08) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: INFO os_vif [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:d9:ef,bridge_name='br-int',has_traffic_filtering=True,id=134a19cd-7f72-44e1-82c0-5ffab04d98b6,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap134a19cd-7f')
Nov 07 04:14:07 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Deleting instance files /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79_del
Nov 07 04:14:07 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Deletion of /opt/stack/data/nova/instances/80624b0b-4c6b-4d6f-9d31-2f7c81e39c79_del complete
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: INFO nova.compute.manager [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 07 04:14:07 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:08 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Took 0.86 seconds to deallocate network for instance.
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-c73396c7-d20f-468d-912e-90ddc28f45cd req-f3672992-5146-4f85-a9ad-a9d068553554 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-deleted-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:08 user nova-compute[74540]: INFO nova.compute.manager [req-c73396c7-d20f-468d-912e-90ddc28f45cd req-f3672992-5146-4f85-a9ad-a9d068553554 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Neutron deleted interface 134a19cd-7f72-44e1-82c0-5ffab04d98b6; detaching it from the instance and deleting it from the info cache
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.network.neutron [req-c73396c7-d20f-468d-912e-90ddc28f45cd req-f3672992-5146-4f85-a9ad-a9d068553554 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-c73396c7-d20f-468d-912e-90ddc28f45cd req-f3672992-5146-4f85-a9ad-a9d068553554 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Detach interface failed, port_id=134a19cd-7f72-44e1-82c0-5ffab04d98b6, reason: Instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:08 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Deleted allocations for instance 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b5a1c9d1-a1d1-46a0-a8be-2c3dd95a40e7 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.328s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:08 user nova-compute[74540]: WARNING nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state deleted and task_state None.
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:08 user nova-compute[74540]: WARNING nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state deleted and task_state None.
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:08 user nova-compute[74540]: WARNING nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state deleted and task_state None.
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-unplugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-unplugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:08 user nova-compute[74540]: WARNING nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-unplugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state deleted and task_state None.
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Acquiring lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] Lock "80624b0b-4c6b-4d6f-9d31-2f7c81e39c79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] No waiting events found dispatching network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:08 user nova-compute[74540]: WARNING nova.compute.manager [req-27be20b8-8772-434c-8c2b-59ba9c1e24d3 req-0b85dc56-ae8d-4445-9a1b-0ba8a6bab892 service nova] [instance: 80624b0b-4c6b-4d6f-9d31-2f7c81e39c79] Received unexpected event network-vif-plugged-134a19cd-7f72-44e1-82c0-5ffab04d98b6 for instance with vm_state deleted and task_state None.
Nov 07 04:14:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-4597a8c9-e8dd-4d00-ac6b-1f884e52731f req-e94d620f-e62b-425c-a045-784df240f08b service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Received event network-changed-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-4597a8c9-e8dd-4d00-ac6b-1f884e52731f req-e94d620f-e62b-425c-a045-784df240f08b service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Refreshing instance network info cache due to event network-changed-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:14:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4597a8c9-e8dd-4d00-ac6b-1f884e52731f req-e94d620f-e62b-425c-a045-784df240f08b service nova] Acquiring lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:14:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4597a8c9-e8dd-4d00-ac6b-1f884e52731f req-e94d620f-e62b-425c-a045-784df240f08b service nova] Acquired lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:14:12 user nova-compute[74540]: DEBUG nova.network.neutron [req-4597a8c9-e8dd-4d00-ac6b-1f884e52731f req-e94d620f-e62b-425c-a045-784df240f08b service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Refreshing network info cache for port 6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG nova.network.neutron [req-4597a8c9-e8dd-4d00-ac6b-1f884e52731f req-e94d620f-e62b-425c-a045-784df240f08b service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Updated VIF entry in instance network info cache for port 6e16179f-e4b8-4bda-a240-bb9ab9fadaf5. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG nova.network.neutron [req-4597a8c9-e8dd-4d00-ac6b-1f884e52731f req-e94d620f-e62b-425c-a045-784df240f08b service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Updating instance_info_cache with network_info: [{"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4597a8c9-e8dd-4d00-ac6b-1f884e52731f req-e94d620f-e62b-425c-a045-784df240f08b service nova] Releasing lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG nova.objects.instance [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lazy-loading 'flavor' on Instance uuid cc15c8fc-e47f-4df0-94ec-8daeacb112c9 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:13 user nova-compute[74540]: INFO nova.compute.manager [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Attaching volume 78af54fb-8bec-4dfd-973f-35c91a08c73f to /dev/vdb
Nov 07 04:14:13 user nova-compute[74540]: DEBUG os_brick.utils [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[59967ac8-f70b-4a40-953f-ebf9ee2da057]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3d94d3-5f52-4345-8c53-e5140a15f475]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55fbe0f-218c-49b7-92ea-c393cb5b8462]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8046d1-be1d-4837-bd6c-5b6a37a5776e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:14:13 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:14:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a320cd7e-04cb-42a2-a4a7-8afba7a2ebad]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG os_brick.utils [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:14:13 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Updating existing volume attachment record: a85690bf-dfa6-49eb-98a2-93e82ed105e8 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:15 user nova-compute[74540]: INFO nova.compute.manager [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Terminating instance
Nov 07 04:14:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e12e36-974c-4044-bed4-1bcb554dc06d req-e9b1ab42-d941-47d5-97cb-fe9cbfcafe37 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-unplugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e12e36-974c-4044-bed4-1bcb554dc06d req-e9b1ab42-d941-47d5-97cb-fe9cbfcafe37 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e12e36-974c-4044-bed4-1bcb554dc06d req-e9b1ab42-d941-47d5-97cb-fe9cbfcafe37 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e12e36-974c-4044-bed4-1bcb554dc06d req-e9b1ab42-d941-47d5-97cb-fe9cbfcafe37 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e12e36-974c-4044-bed4-1bcb554dc06d req-e9b1ab42-d941-47d5-97cb-fe9cbfcafe37 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-unplugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e12e36-974c-4044-bed4-1bcb554dc06d req-e9b1ab42-d941-47d5-97cb-fe9cbfcafe37 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-unplugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:14:15 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Instance destroyed successfully.
Nov 07 04:14:15 user nova-compute[74540]: DEBUG nova.objects.instance [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lazy-loading 'resources' on Instance uuid 22ebfad2-30ec-4f1a-8575-d655d36c6f91 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T03:56:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-345609166',display_name='tempest-ServerRescueNegativeTestJSON-server-345609166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-345609166',id=1,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:01:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60a9f3df6bba4675b2332ac4ded5373e',ramdisk_id='',reservation_id='r-rw6qcnv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1326022799',owner_user_name='tempest-ServerRescueNegativeTestJSON-1326022799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:03:20Z,user_data=None,user_id='c3b660fa816a404196af3027d19aea51',uuid=22ebfad2-30ec-4f1a-8575-d655d36c6f91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converting VIF {"id": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "address": "fa:16:3e:75:7b:81", "network": {"id": "18c05301-d351-4863-a23a-2f50d2c15881", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1010308086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60a9f3df6bba4675b2332ac4ded5373e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22b86445-e9", "ovs_interfaceid": "22b86445-e99f-4e4c-a265-bd37533ae9cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:7b:81,bridge_name='br-int',has_traffic_filtering=True,id=22b86445-e99f-4e4c-a265-bd37533ae9cf,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b86445-e9') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG os_vif [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:7b:81,bridge_name='br-int',has_traffic_filtering=True,id=22b86445-e99f-4e4c-a265-bd37533ae9cf,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b86445-e9') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22b86445-e9, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39edd2d7-7d41-49d4-b7be-e95a4c821305) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:15 user nova-compute[74540]: INFO os_vif [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:7b:81,bridge_name='br-int',has_traffic_filtering=True,id=22b86445-e99f-4e4c-a265-bd37533ae9cf,network=Network(18c05301-d351-4863-a23a-2f50d2c15881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22b86445-e9')
Nov 07 04:14:15 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Deleting instance files /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91_del
Nov 07 04:14:15 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Deletion of /opt/stack/data/nova/instances/22ebfad2-30ec-4f1a-8575-d655d36c6f91_del complete
Nov 07 04:14:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:16 user nova-compute[74540]: INFO nova.compute.manager [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 07 04:14:16 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:14:16 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:14:16 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:14:16 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:16 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Took 0.58 seconds to deallocate network for instance.
Nov 07 04:14:16 user nova-compute[74540]: DEBUG nova.compute.manager [req-72de3760-7b58-4d1c-9126-ebdfb9acbd0a req-56d5fc08-1232-42af-a08f-0c3ee0181f8e service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-deleted-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:16 user nova-compute[74540]: INFO nova.compute.manager [req-72de3760-7b58-4d1c-9126-ebdfb9acbd0a req-56d5fc08-1232-42af-a08f-0c3ee0181f8e service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Neutron deleted interface 22b86445-e99f-4e4c-a265-bd37533ae9cf; detaching it from the instance and deleting it from the info cache
Nov 07 04:14:16 user nova-compute[74540]: DEBUG nova.network.neutron [req-72de3760-7b58-4d1c-9126-ebdfb9acbd0a req-56d5fc08-1232-42af-a08f-0c3ee0181f8e service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:16 user nova-compute[74540]: DEBUG nova.compute.manager [req-72de3760-7b58-4d1c-9126-ebdfb9acbd0a req-56d5fc08-1232-42af-a08f-0c3ee0181f8e service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Detach interface failed, port_id=22b86445-e99f-4e4c-a265-bd37533ae9cf, reason: Instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:14:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:17 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:14:17 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:14:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:17 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Deleted allocations for instance 22ebfad2-30ec-4f1a-8575-d655d36c6f91
Nov 07 04:14:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-52cfc90e-6f8a-4a26-b5c3-5953cbe4403b tempest-ServerRescueNegativeTestJSON-1326022799 tempest-ServerRescueNegativeTestJSON-1326022799-project-member] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.115s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-0322ea5a-527d-4220-b5ae-b960fb128bcb req-88e8be76-3e64-4ff5-81ab-5b5db9556316 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0322ea5a-527d-4220-b5ae-b960fb128bcb req-88e8be76-3e64-4ff5-81ab-5b5db9556316 service nova] Acquiring lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0322ea5a-527d-4220-b5ae-b960fb128bcb req-88e8be76-3e64-4ff5-81ab-5b5db9556316 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0322ea5a-527d-4220-b5ae-b960fb128bcb req-88e8be76-3e64-4ff5-81ab-5b5db9556316 service nova] Lock "22ebfad2-30ec-4f1a-8575-d655d36c6f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-0322ea5a-527d-4220-b5ae-b960fb128bcb req-88e8be76-3e64-4ff5-81ab-5b5db9556316 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] No waiting events found dispatching network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:17 user nova-compute[74540]: WARNING nova.compute.manager [req-0322ea5a-527d-4220-b5ae-b960fb128bcb req-88e8be76-3e64-4ff5-81ab-5b5db9556316 service nova] [instance: 22ebfad2-30ec-4f1a-8575-d655d36c6f91] Received unexpected event network-vif-plugged-22b86445-e99f-4e4c-a265-bd37533ae9cf for instance with vm_state deleted and task_state None.
Nov 07 04:14:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "385719ec-63d8-4c6d-a366-92fe921e70a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:21 user nova-compute[74540]: INFO nova.compute.manager [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Terminating instance
Nov 07 04:14:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-854361f8-cf6e-402f-b833-82d707aa1a5e req-fdbfb2a7-c89a-4125-82c0-744b3b0d4052 service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Received event network-vif-unplugged-799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-854361f8-cf6e-402f-b833-82d707aa1a5e req-fdbfb2a7-c89a-4125-82c0-744b3b0d4052 service nova] Acquiring lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-854361f8-cf6e-402f-b833-82d707aa1a5e req-fdbfb2a7-c89a-4125-82c0-744b3b0d4052 service nova] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-854361f8-cf6e-402f-b833-82d707aa1a5e req-fdbfb2a7-c89a-4125-82c0-744b3b0d4052 service nova] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-854361f8-cf6e-402f-b833-82d707aa1a5e req-fdbfb2a7-c89a-4125-82c0-744b3b0d4052 service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] No waiting events found dispatching network-vif-unplugged-799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-854361f8-cf6e-402f-b833-82d707aa1a5e req-fdbfb2a7-c89a-4125-82c0-744b3b0d4052 service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Received event network-vif-unplugged-799c3fc0-d40b-4411-bd8d-44f080a0eead for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:14:22 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Instance destroyed successfully.
Nov 07 04:14:22 user nova-compute[74540]: DEBUG nova.objects.instance [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lazy-loading 'resources' on Instance uuid 385719ec-63d8-4c6d-a366-92fe921e70a6 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-914371902',display_name='tempest-VolumesActionsTest-instance-914371902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-914371902',id=30,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:12:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b13ca54283e24792a14346398c50e8c9',ramdisk_id='',reservation_id='r-m083w4tl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1216468883',owner_user_name='tempest-VolumesActionsTest-1216468883-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:12:37Z,user_data=None,user_id='19215be651f54d5aa160548205a6dc93',uuid=385719ec-63d8-4c6d-a366-92fe921e70a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "address": "fa:16:3e:a1:23:73", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c3fc0-d4", "ovs_interfaceid": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Converting VIF {"id": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "address": "fa:16:3e:a1:23:73", "network": {"id": "d92ae067-0902-4bf5-ad23-2df730d65d32", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1598539791-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b13ca54283e24792a14346398c50e8c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799c3fc0-d4", "ovs_interfaceid": "799c3fc0-d40b-4411-bd8d-44f080a0eead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:23:73,bridge_name='br-int',has_traffic_filtering=True,id=799c3fc0-d40b-4411-bd8d-44f080a0eead,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c3fc0-d4') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG os_vif [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:23:73,bridge_name='br-int',has_traffic_filtering=True,id=799c3fc0-d40b-4411-bd8d-44f080a0eead,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c3fc0-d4') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap799c3fc0-d4, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b45df42-fd88-4be3-b5f0-e50d63a154df) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:14:22 user nova-compute[74540]: INFO os_vif [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:23:73,bridge_name='br-int',has_traffic_filtering=True,id=799c3fc0-d40b-4411-bd8d-44f080a0eead,network=Network(d92ae067-0902-4bf5-ad23-2df730d65d32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799c3fc0-d4')
Nov 07 04:14:22 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Deleting instance files /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6_del
Nov 07 04:14:22 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Deletion of /opt/stack/data/nova/instances/385719ec-63d8-4c6d-a366-92fe921e70a6_del complete
Nov 07 04:14:22 user nova-compute[74540]: INFO nova.compute.manager [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 07 04:14:22 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:22 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Took 0.48 seconds to deallocate network for instance.
Nov 07 04:14:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-3d28cb41-2e84-464b-ab78-321c350f367a req-5a6a6a44-11ca-49dc-9557-52eb5eee4f76 service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Received event network-vif-deleted-799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:22 user nova-compute[74540]: INFO nova.compute.manager [req-3d28cb41-2e84-464b-ab78-321c350f367a req-5a6a6a44-11ca-49dc-9557-52eb5eee4f76 service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Neutron deleted interface 799c3fc0-d40b-4411-bd8d-44f080a0eead; detaching it from the instance and deleting it from the info cache
Nov 07 04:14:22 user nova-compute[74540]: DEBUG nova.network.neutron [req-3d28cb41-2e84-464b-ab78-321c350f367a req-5a6a6a44-11ca-49dc-9557-52eb5eee4f76 service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-3d28cb41-2e84-464b-ab78-321c350f367a req-5a6a6a44-11ca-49dc-9557-52eb5eee4f76 service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Detach interface failed, port_id=799c3fc0-d40b-4411-bd8d-44f080a0eead, reason: Instance 385719ec-63d8-4c6d-a366-92fe921e70a6 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:14:22 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:14:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:23 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Deleted allocations for instance 385719ec-63d8-4c6d-a366-92fe921e70a6
Nov 07 04:14:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-38dfd207-df7e-4ff3-9117-6777679b1e70 tempest-VolumesActionsTest-1216468883 tempest-VolumesActionsTest-1216468883-project-member] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.751s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-1624be87-202e-4480-8cc6-09a156194e1b req-1e3af0ba-fc6d-4a1c-bfd8-972253c67232 service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Received event network-vif-plugged-799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1624be87-202e-4480-8cc6-09a156194e1b req-1e3af0ba-fc6d-4a1c-bfd8-972253c67232 service nova] Acquiring lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1624be87-202e-4480-8cc6-09a156194e1b req-1e3af0ba-fc6d-4a1c-bfd8-972253c67232 service nova] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1624be87-202e-4480-8cc6-09a156194e1b req-1e3af0ba-fc6d-4a1c-bfd8-972253c67232 service nova] Lock "385719ec-63d8-4c6d-a366-92fe921e70a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-1624be87-202e-4480-8cc6-09a156194e1b req-1e3af0ba-fc6d-4a1c-bfd8-972253c67232 service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] No waiting events found dispatching network-vif-plugged-799c3fc0-d40b-4411-bd8d-44f080a0eead {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:23 user nova-compute[74540]: WARNING nova.compute.manager [req-1624be87-202e-4480-8cc6-09a156194e1b req-1e3af0ba-fc6d-4a1c-bfd8-972253c67232 service nova] [instance: 385719ec-63d8-4c6d-a366-92fe921e70a6] Received unexpected event network-vif-plugged-799c3fc0-d40b-4411-bd8d-44f080a0eead for instance with vm_state deleted and task_state None.
Nov 07 04:14:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:27 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 20aefb10-e25b-4227-ba94-aaa411050d80 is timed out.
Nov 07 04:14:27 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Successfully detached device vdb from instance 20aefb10-e25b-4227-ba94-aaa411050d80 from the live domain config.
Nov 07 04:14:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laFEtszr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:14:27 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c819268-2684-42dd-875b-7a469e543074]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:14:27 user nova-compute[74540]: No targets found.
Nov 07 04:14:27 user nova-compute[74540]: iSNS:
Nov 07 04:14:27 user nova-compute[74540]: No targets found.
Nov 07 04:14:27 user nova-compute[74540]: STATIC:
Nov 07 04:14:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c
Nov 07 04:14:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:14:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:14:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1
Nov 07 04:14:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:14:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:14:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:14:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:14:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:14:27 user nova-compute[74540]: FIRMWARE:
Nov 07 04:14:27 user nova-compute[74540]: No targets found.
Nov 07 04:14:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:14:27 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:14:27 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[78612b3a-b676-44f8-8697-2de3d333ac85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe363d9-b70e-4174-84da-e2c0b038cde7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:14:27 user nova-compute[74540]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)
Nov 07 04:14:27 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:14:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:14:27 user nova-compute[74540]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c (non-flash)
Nov 07 04:14:27 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:14:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc39cd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b23c9f-ebfd-45b7-ad63-1fa3f0b3d51f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92c5e11-ad31-476d-8e2c-ca1a4ef870f7]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[855ee3e7-0a54-4446-a44f-a43cd070c133]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdfe1b4-23d8-4656-8c25-6543e048c69d]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a2c7de-14d2-4416-9392-ec35deeb8a76]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1f7a59-9852-499f-aceb-88a9663d4edf]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c, portal: 172.16.0.220,3260]
Nov 07 04:14:27 user nova-compute[74540]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c, portal: 172.16.0.220,3260] successful.
Nov 07 04:14:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2566a427-6a3e-46c8-b84b-4fca3ffd364d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] <== disconnect_volume: return (301ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:14:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG nova.objects.instance [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lazy-loading 'flavor' on Instance uuid 20aefb10-e25b-4227-ba94-aaa411050d80 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-55744425-aed3-4eba-aeb6-f904af8b935b tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "20aefb10-e25b-4227-ba94-aaa411050d80" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.477s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "20aefb10-e25b-4227-ba94-aaa411050d80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.334s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:28 user nova-compute[74540]: INFO nova.compute.manager [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Terminating instance
Nov 07 04:14:28 user nova-compute[74540]: DEBUG nova.compute.manager [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-7429e142-d973-4a0c-a9ed-4be04a0fd847 req-61eb2e5a-119d-435f-9403-bf40950e30bc service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Received event network-vif-unplugged-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7429e142-d973-4a0c-a9ed-4be04a0fd847 req-61eb2e5a-119d-435f-9403-bf40950e30bc service nova] Acquiring lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7429e142-d973-4a0c-a9ed-4be04a0fd847 req-61eb2e5a-119d-435f-9403-bf40950e30bc service nova] Lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7429e142-d973-4a0c-a9ed-4be04a0fd847 req-61eb2e5a-119d-435f-9403-bf40950e30bc service nova] Lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-7429e142-d973-4a0c-a9ed-4be04a0fd847 req-61eb2e5a-119d-435f-9403-bf40950e30bc service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] No waiting events found dispatching network-vif-unplugged-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:28 user nova-compute[74540]: DEBUG nova.compute.manager [req-7429e142-d973-4a0c-a9ed-4be04a0fd847 req-61eb2e5a-119d-435f-9403-bf40950e30bc service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Received event network-vif-unplugged-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:14:29 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Instance destroyed successfully.
Nov 07 04:14:29 user nova-compute[74540]: DEBUG nova.objects.instance [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lazy-loading 'resources' on Instance uuid 20aefb10-e25b-4227-ba94-aaa411050d80 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-82778165',display_name='tempest-VolumesSnapshotTestJSON-instance-82778165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-82778165',id=26,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9Ehk+azZXXpAmto134LgHBJNQAp258bm9xrDVI1HWG69cEjuF2eqdh6ZaY5PywbMhAbj9him3S5MxVyexU4CLqhXHf1uPDgx5a6aecmTZwl3gGeiES6O+12i9GYXF5HA==',key_name='tempest-keypair-1827399304',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:10:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b682de4430634d9c88abd728196079a0',ramdisk_id='',reservation_id='r-286cumey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1818707028',owner_user_name='tempest-VolumesSnapshotTestJSON-1818707028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c598b2585a41829af42b129ccb51fa',uuid=20aefb10-e25b-4227-ba94-aaa411050d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "address": "fa:16:3e:ea:cb:59", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b49c82-01", "ovs_interfaceid": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Converting VIF {"id": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "address": "fa:16:3e:ea:cb:59", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6b49c82-01", "ovs_interfaceid": "e6b49c82-01c9-4c16-90ca-93a9faf2d5a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=e6b49c82-01c9-4c16-90ca-93a9faf2d5a0,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b49c82-01') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_vif [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=e6b49c82-01c9-4c16-90ca-93a9faf2d5a0,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b49c82-01') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6b49c82-01, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=258af2ba-179c-47a5-9aa3-6761c0c108b9) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:14:29 user nova-compute[74540]: INFO os_vif [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:cb:59,bridge_name='br-int',has_traffic_filtering=True,id=e6b49c82-01c9-4c16-90ca-93a9faf2d5a0,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6b49c82-01')
Nov 07 04:14:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laFEtszr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:14:29 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a8802-126f-4465-9eb9-c8d0a8eb3398]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:14:29 user nova-compute[74540]: No targets found.
Nov 07 04:14:29 user nova-compute[74540]: iSNS:
Nov 07 04:14:29 user nova-compute[74540]: No targets found.
Nov 07 04:14:29 user nova-compute[74540]: STATIC:
Nov 07 04:14:29 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1
Nov 07 04:14:29 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:14:29 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:14:29 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:14:29 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:14:29 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:14:29 user nova-compute[74540]: FIRMWARE:
Nov 07 04:14:29 user nova-compute[74540]: No targets found.
Nov 07 04:14:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:14:29 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:14:29 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4880b4b-db43-41a1-8181-c3fb93f5a79c', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bc1c13-287d-4c76-aa9a-e10306724ef4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[913fdc14-f1ad-42d6-a5b6-905285c032a7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:14:29 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:14:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:14:29 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:14:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc389bd0>, {}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Disconnecting from: [] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] <== disconnect_volume: return (70ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:14:29 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Deleting instance files /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80_del
Nov 07 04:14:29 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Deletion of /opt/stack/data/nova/instances/20aefb10-e25b-4227-ba94-aaa411050d80_del complete
Nov 07 04:14:29 user nova-compute[74540]: INFO nova.compute.manager [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 07 04:14:29 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:14:29 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:14:30 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:30 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Took 0.73 seconds to deallocate network for instance.
Nov 07 04:14:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-3e163110-46c0-4081-9fc9-9b1931bf6694 req-878dc8c1-e68e-4c95-8672-c27d953dd64c service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Received event network-vif-deleted-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:30 user nova-compute[74540]: INFO nova.compute.manager [req-3e163110-46c0-4081-9fc9-9b1931bf6694 req-878dc8c1-e68e-4c95-8672-c27d953dd64c service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Neutron deleted interface e6b49c82-01c9-4c16-90ca-93a9faf2d5a0; detaching it from the instance and deleting it from the info cache
Nov 07 04:14:30 user nova-compute[74540]: DEBUG nova.network.neutron [req-3e163110-46c0-4081-9fc9-9b1931bf6694 req-878dc8c1-e68e-4c95-8672-c27d953dd64c service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-3e163110-46c0-4081-9fc9-9b1931bf6694 req-878dc8c1-e68e-4c95-8672-c27d953dd64c service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Detach interface failed, port_id=e6b49c82-01c9-4c16-90ca-93a9faf2d5a0, reason: Instance 20aefb10-e25b-4227-ba94-aaa411050d80 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:14:30 user nova-compute[74540]: WARNING nova.volume.cinder [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Attachment 1f70b959-f1f3-4004-81be-437c0393c128 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1f70b959-f1f3-4004-81be-437c0393c128. (HTTP 404) (Request-ID: req-61c6ceb4-4b96-424c-97cb-a8d3b751de84)
Nov 07 04:14:30 user nova-compute[74540]: INFO nova.compute.manager [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Took 0.03 seconds to detach 1 volumes for instance.
Nov 07 04:14:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:30 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:14:30 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:14:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:30 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Deleted allocations for instance 20aefb10-e25b-4227-ba94-aaa411050d80
Nov 07 04:14:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-444c3f4e-ec6f-4fb8-82b7-2a2a77d57486 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "20aefb10-e25b-4227-ba94-aaa411050d80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.094s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-34747c16-34c2-4ee0-bdf8-54e8b9e8e3c4 req-26038a32-f05c-40d8-be77-d661cfc5b34f service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Received event network-vif-plugged-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-34747c16-34c2-4ee0-bdf8-54e8b9e8e3c4 req-26038a32-f05c-40d8-be77-d661cfc5b34f service nova] Acquiring lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-34747c16-34c2-4ee0-bdf8-54e8b9e8e3c4 req-26038a32-f05c-40d8-be77-d661cfc5b34f service nova] Lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-34747c16-34c2-4ee0-bdf8-54e8b9e8e3c4 req-26038a32-f05c-40d8-be77-d661cfc5b34f service nova] Lock "20aefb10-e25b-4227-ba94-aaa411050d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-34747c16-34c2-4ee0-bdf8-54e8b9e8e3c4 req-26038a32-f05c-40d8-be77-d661cfc5b34f service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] No waiting events found dispatching network-vif-plugged-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:31 user nova-compute[74540]: WARNING nova.compute.manager [req-34747c16-34c2-4ee0-bdf8-54e8b9e8e3c4 req-26038a32-f05c-40d8-be77-d661cfc5b34f service nova] [instance: 20aefb10-e25b-4227-ba94-aaa411050d80] Received unexpected event network-vif-plugged-e6b49c82-01c9-4c16-90ca-93a9faf2d5a0 for instance with vm_state deleted and task_state None.
Nov 07 04:14:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vAMCHUYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:14:36 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:14:36 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:14:36 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4623b98-4827-406e-8143-0c61eb930b1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:14:36 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[272d605a-cb05-43ae-80aa-198b790eb32d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f] added
Nov 07 04:14:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[be705b26-60d2-4ffa-8761-512ac3e3898c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4e6a43-afaa-4b1e-8d5e-bd82667efc24]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vAMCHUYX {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vAMCHUYX" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a714a858-f735-4a14-a438-90c23019757e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vAMCHUYX'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcc3ca0-3ba7-4f29-81c7-2f392f6b8f5a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b887744-5508-41c2-aed2-9c0c7a48141b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:14:36 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:14:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:14:36 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:14:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8965a280-3812-4ec4-965c-f154567aa84e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f, portal: 172.16.0.220,3260]
Nov 07 04:14:36 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f, portal: 172.16.0.220,3260] successful.
Nov 07 04:14:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a201359-dab3-4ae5-93db-67ca03bc8769]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8902f34-5060-482a-b5eb-6c0b1e1e3689]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:14:36 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:14:36 user nova-compute[74540]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f (non-flash)
Nov 07 04:14:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:14:36 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:14:36 user nova-compute[74540]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f (non-flash)
Nov 07 04:14:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c3eea-8749-4d32-8d33-3e82f68776e4]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:14:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vAMCHUYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:14:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:14:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23434376535373162', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:14:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434376535373162', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:14:37 user nova-compute[74540]: DEBUG nova.objects.instance [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lazy-loading 'flavor' on Instance uuid cc15c8fc-e47f-4df0-94ec-8daeacb112c9 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:14:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:14:37 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:14:37 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:14:37 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:14:37 user nova-compute[74540]:   <serial>78af54fb-8bec-4dfd-973f-35c91a08c73f</serial>
Nov 07 04:14:37 user nova-compute[74540]: </disk>
Nov 07 04:14:37 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:14:37 user nova-compute[74540]: INFO nova.compute.manager [None req-7f3268d3-f730-4920-a3f9-72a0a255211a tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Unrescuing
Nov 07 04:14:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7f3268d3-f730-4920-a3f9-72a0a255211a tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:14:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7f3268d3-f730-4920-a3f9-72a0a255211a tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquired lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:14:37 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7f3268d3-f730-4920-a3f9-72a0a255211a tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] No VIF found with MAC fa:16:3e:7f:b8:4d, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG nova.network.neutron [None req-7f3268d3-f730-4920-a3f9-72a0a255211a tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Updating instance_info_cache with network_info: [{"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7f3268d3-f730-4920-a3f9-72a0a255211a tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Releasing lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7f3268d3-f730-4920-a3f9-72a0a255211a tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'flavor' on Instance uuid ac4742cd-822a-43b1-adc7-4c7452bd0e35 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fb8e4693-b32c-4593-9440-a8621ff765c2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.123s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG nova.compute.manager [req-d61cb4be-640f-48da-86af-6899977dd2cc req-6e8dfb4f-9ba4-43c0-9122-a43d07b28da7 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-unplugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d61cb4be-640f-48da-86af-6899977dd2cc req-6e8dfb4f-9ba4-43c0-9122-a43d07b28da7 service nova] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d61cb4be-640f-48da-86af-6899977dd2cc req-6e8dfb4f-9ba4-43c0-9122-a43d07b28da7 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d61cb4be-640f-48da-86af-6899977dd2cc req-6e8dfb4f-9ba4-43c0-9122-a43d07b28da7 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG nova.compute.manager [req-d61cb4be-640f-48da-86af-6899977dd2cc req-6e8dfb4f-9ba4-43c0-9122-a43d07b28da7 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] No waiting events found dispatching network-vif-unplugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:38 user nova-compute[74540]: WARNING nova.compute.manager [req-d61cb4be-640f-48da-86af-6899977dd2cc req-6e8dfb4f-9ba4-43c0-9122-a43d07b28da7 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received unexpected event network-vif-unplugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:14:38 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:39 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Instance destroyed successfully.
Nov 07 04:14:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-9ba2bedd-9564-47b0-9ed0-31bfcc0da838 req-1a12a5a8-ebbd-4cfe-b7b2-1822e7be27ad service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9ba2bedd-9564-47b0-9ed0-31bfcc0da838 req-1a12a5a8-ebbd-4cfe-b7b2-1822e7be27ad service nova] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9ba2bedd-9564-47b0-9ed0-31bfcc0da838 req-1a12a5a8-ebbd-4cfe-b7b2-1822e7be27ad service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9ba2bedd-9564-47b0-9ed0-31bfcc0da838 req-1a12a5a8-ebbd-4cfe-b7b2-1822e7be27ad service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-9ba2bedd-9564-47b0-9ed0-31bfcc0da838 req-1a12a5a8-ebbd-4cfe-b7b2-1822e7be27ad service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] No waiting events found dispatching network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:40 user nova-compute[74540]: WARNING nova.compute.manager [req-9ba2bedd-9564-47b0-9ed0-31bfcc0da838 req-1a12a5a8-ebbd-4cfe-b7b2-1822e7be27ad service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received unexpected event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:14:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-9ba2bedd-9564-47b0-9ed0-31bfcc0da838 req-1a12a5a8-ebbd-4cfe-b7b2-1822e7be27ad service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9ba2bedd-9564-47b0-9ed0-31bfcc0da838 req-1a12a5a8-ebbd-4cfe-b7b2-1822e7be27ad service nova] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9ba2bedd-9564-47b0-9ed0-31bfcc0da838 req-1a12a5a8-ebbd-4cfe-b7b2-1822e7be27ad service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9ba2bedd-9564-47b0-9ed0-31bfcc0da838 req-1a12a5a8-ebbd-4cfe-b7b2-1822e7be27ad service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-9ba2bedd-9564-47b0-9ed0-31bfcc0da838 req-1a12a5a8-ebbd-4cfe-b7b2-1822e7be27ad service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] No waiting events found dispatching network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:40 user nova-compute[74540]: WARNING nova.compute.manager [req-9ba2bedd-9564-47b0-9ed0-31bfcc0da838 req-1a12a5a8-ebbd-4cfe-b7b2-1822e7be27ad service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received unexpected event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:14:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:41 user nova-compute[74540]: INFO nova.compute.manager [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Detaching volume 78af54fb-8bec-4dfd-973f-35c91a08c73f
Nov 07 04:14:41 user nova-compute[74540]: INFO nova.virt.block_device [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Attempting to driver detach volume 78af54fb-8bec-4dfd-973f-35c91a08c73f from mountpoint /dev/vdb
Nov 07 04:14:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Attempting to detach device vdb from instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:14:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:14:41 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:14:41 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:14:41 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:14:41 user nova-compute[74540]:   <serial>78af54fb-8bec-4dfd-973f-35c91a08c73f</serial>
Nov 07 04:14:41 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:14:41 user nova-compute[74540]: </disk>
Nov 07 04:14:41 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:14:41 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Successfully detached device vdb from instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 from the persistent domain config.
Nov 07 04:14:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:14:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:14:41 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:14:41 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:14:41 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:14:41 user nova-compute[74540]:   <serial>78af54fb-8bec-4dfd-973f-35c91a08c73f</serial>
Nov 07 04:14:41 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:14:41 user nova-compute[74540]: </disk>
Nov 07 04:14:41 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:14:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:14:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:14:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:42 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:14:42 user nova-compute[74540]: DEBUG nova.compute.manager [req-488a0c0b-5fd2-4173-8cc9-95910aaefe1e req-83f8c552-3a1d-475e-af68-6303ae7dc663 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-488a0c0b-5fd2-4173-8cc9-95910aaefe1e req-83f8c552-3a1d-475e-af68-6303ae7dc663 service nova] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-488a0c0b-5fd2-4173-8cc9-95910aaefe1e req-83f8c552-3a1d-475e-af68-6303ae7dc663 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-488a0c0b-5fd2-4173-8cc9-95910aaefe1e req-83f8c552-3a1d-475e-af68-6303ae7dc663 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:42 user nova-compute[74540]: DEBUG nova.compute.manager [req-488a0c0b-5fd2-4173-8cc9-95910aaefe1e req-83f8c552-3a1d-475e-af68-6303ae7dc663 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] No waiting events found dispatching network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:42 user nova-compute[74540]: WARNING nova.compute.manager [req-488a0c0b-5fd2-4173-8cc9-95910aaefe1e req-83f8c552-3a1d-475e-af68-6303ae7dc663 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received unexpected event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:14:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7f3268d3-f730-4920-a3f9-72a0a255211a tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:14:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:14:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:14:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:14:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:14:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:46 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:14:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:14:47 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:14:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:48 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:14:48 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:14:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8167MB free_disk=25.01494598388672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:14:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:14:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:14:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:14:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:14:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bbed18c8-efc2-453e-825c-caf6a686c9cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:14:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:14:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:14:49 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:14:49 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:14:49 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:14:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:14:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:14:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:14:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:14:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:14:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updating instance_info_cache with network_info: [{"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:14:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:14:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:14:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Acquiring lock "93ecf822-fcd9-41cc-97a3-3b92a49571da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:52 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:14:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:52 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:14:52 user nova-compute[74540]: INFO nova.compute.claims [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Claim successful on node user
Nov 07 04:14:53 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:14:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:14:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG nova.policy [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b4e00e8bf1c48a99a973405f8d55237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc7db70c9ecb4ec9bee371401852de5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:14:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Creating image(s)
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Acquiring lock "/opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "/opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "/opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.169s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk 1073741824" returned: 0 in 0.057s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.173s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:14:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Successfully created port: a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Cannot resize image /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Ensure instance console log exists: /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Successfully updated port: a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Acquiring lock "refresh_cache-93ecf822-fcd9-41cc-97a3-3b92a49571da" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Acquired lock "refresh_cache-93ecf822-fcd9-41cc-97a3-3b92a49571da" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-f53aad7f-7fc8-4fda-9de4-f8901ea46f68 req-3d8ab7da-bd8b-49c8-a788-e4ac66aa7b58 service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Received event network-changed-a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-f53aad7f-7fc8-4fda-9de4-f8901ea46f68 req-3d8ab7da-bd8b-49c8-a788-e4ac66aa7b58 service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Refreshing instance network info cache due to event network-changed-a81b28d3-914c-4570-a633-b062f9e351e6. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f53aad7f-7fc8-4fda-9de4-f8901ea46f68 req-3d8ab7da-bd8b-49c8-a788-e4ac66aa7b58 service nova] Acquiring lock "refresh_cache-93ecf822-fcd9-41cc-97a3-3b92a49571da" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Updating instance_info_cache with network_info: [{"id": "a81b28d3-914c-4570-a633-b062f9e351e6", "address": "fa:16:3e:79:d8:7e", "network": {"id": "6e71c4f4-8055-40f3-bc5f-f3c806c758f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-702351221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc7db70c9ecb4ec9bee371401852de5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b28d3-91", "ovs_interfaceid": "a81b28d3-914c-4570-a633-b062f9e351e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Releasing lock "refresh_cache-93ecf822-fcd9-41cc-97a3-3b92a49571da" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Instance network_info: |[{"id": "a81b28d3-914c-4570-a633-b062f9e351e6", "address": "fa:16:3e:79:d8:7e", "network": {"id": "6e71c4f4-8055-40f3-bc5f-f3c806c758f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-702351221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc7db70c9ecb4ec9bee371401852de5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b28d3-91", "ovs_interfaceid": "a81b28d3-914c-4570-a633-b062f9e351e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f53aad7f-7fc8-4fda-9de4-f8901ea46f68 req-3d8ab7da-bd8b-49c8-a788-e4ac66aa7b58 service nova] Acquired lock "refresh_cache-93ecf822-fcd9-41cc-97a3-3b92a49571da" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.network.neutron [req-f53aad7f-7fc8-4fda-9de4-f8901ea46f68 req-3d8ab7da-bd8b-49c8-a788-e4ac66aa7b58 service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Refreshing network info cache for port a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Start _get_guest_xml network_info=[{"id": "a81b28d3-914c-4570-a633-b062f9e351e6", "address": "fa:16:3e:79:d8:7e", "network": {"id": "6e71c4f4-8055-40f3-bc5f-f3c806c758f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-702351221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc7db70c9ecb4ec9bee371401852de5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b28d3-91", "ovs_interfaceid": "a81b28d3-914c-4570-a633-b062f9e351e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:14:54 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:14:54 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1083884345',display_name='tempest-VolumesActionsTest-instance-1083884345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1083884345',id=32,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc7db70c9ecb4ec9bee371401852de5e',ramdisk_id='',reservation_id='r-85ptj6fu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-885401094',owner_user_name='tempest-VolumesActionsTest-885401094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:14:53Z,user_data=None,user_id='2b4e00e8bf1c48a99a973405f8d55237',uuid=93ecf822-fcd9-41cc-97a3-3b92a49571da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a81b28d3-914c-4570-a633-b062f9e351e6", "address": "fa:16:3e:79:d8:7e", "network": {"id": "6e71c4f4-8055-40f3-bc5f-f3c806c758f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-702351221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc7db70c9ecb4ec9bee371401852de5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b28d3-91", "ovs_interfaceid": "a81b28d3-914c-4570-a633-b062f9e351e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Converting VIF {"id": "a81b28d3-914c-4570-a633-b062f9e351e6", "address": "fa:16:3e:79:d8:7e", "network": {"id": "6e71c4f4-8055-40f3-bc5f-f3c806c758f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-702351221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc7db70c9ecb4ec9bee371401852de5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b28d3-91", "ovs_interfaceid": "a81b28d3-914c-4570-a633-b062f9e351e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:d8:7e,bridge_name='br-int',has_traffic_filtering=True,id=a81b28d3-914c-4570-a633-b062f9e351e6,network=Network(6e71c4f4-8055-40f3-bc5f-f3c806c758f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b28d3-91') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.objects.instance [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lazy-loading 'pci_devices' on Instance uuid 93ecf822-fcd9-41cc-97a3-3b92a49571da {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:14:54 user nova-compute[74540]:   <uuid>93ecf822-fcd9-41cc-97a3-3b92a49571da</uuid>
Nov 07 04:14:54 user nova-compute[74540]:   <name>instance-00000020</name>
Nov 07 04:14:54 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:14:54 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:14:54 user nova-compute[74540]:   <metadata>
Nov 07 04:14:54 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:14:54 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:14:54 user nova-compute[74540]:       <nova:name>tempest-VolumesActionsTest-instance-1083884345</nova:name>
Nov 07 04:14:54 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:14:54</nova:creationTime>
Nov 07 04:14:54 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:14:54 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:14:54 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:14:54 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:14:54 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:14:54 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:14:54 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:14:54 user nova-compute[74540]:       <nova:owner>
Nov 07 04:14:54 user nova-compute[74540]:         <nova:user uuid="2b4e00e8bf1c48a99a973405f8d55237">tempest-VolumesActionsTest-885401094-project-member</nova:user>
Nov 07 04:14:54 user nova-compute[74540]:         <nova:project uuid="fc7db70c9ecb4ec9bee371401852de5e">tempest-VolumesActionsTest-885401094</nova:project>
Nov 07 04:14:54 user nova-compute[74540]:       </nova:owner>
Nov 07 04:14:54 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:14:54 user nova-compute[74540]:       <nova:ports>
Nov 07 04:14:54 user nova-compute[74540]:         <nova:port uuid="a81b28d3-914c-4570-a633-b062f9e351e6">
Nov 07 04:14:54 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:14:54 user nova-compute[74540]:         </nova:port>
Nov 07 04:14:54 user nova-compute[74540]:       </nova:ports>
Nov 07 04:14:54 user nova-compute[74540]:     </nova:instance>
Nov 07 04:14:54 user nova-compute[74540]:   </metadata>
Nov 07 04:14:54 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:14:54 user nova-compute[74540]:     <system>
Nov 07 04:14:54 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:14:54 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:14:54 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:14:54 user nova-compute[74540]:       <entry name="serial">93ecf822-fcd9-41cc-97a3-3b92a49571da</entry>
Nov 07 04:14:54 user nova-compute[74540]:       <entry name="uuid">93ecf822-fcd9-41cc-97a3-3b92a49571da</entry>
Nov 07 04:14:54 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:14:54 user nova-compute[74540]:     </system>
Nov 07 04:14:54 user nova-compute[74540]:   </sysinfo>
Nov 07 04:14:54 user nova-compute[74540]:   <os>
Nov 07 04:14:54 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:14:54 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:14:54 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:14:54 user nova-compute[74540]:   </os>
Nov 07 04:14:54 user nova-compute[74540]:   <features>
Nov 07 04:14:54 user nova-compute[74540]:     <acpi/>
Nov 07 04:14:54 user nova-compute[74540]:     <apic/>
Nov 07 04:14:54 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:14:54 user nova-compute[74540]:   </features>
Nov 07 04:14:54 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:14:54 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:14:54 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:14:54 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:14:54 user nova-compute[74540]:   </clock>
Nov 07 04:14:54 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:14:54 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:14:54 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:14:54 user nova-compute[74540]:   </cpu>
Nov 07 04:14:54 user nova-compute[74540]:   <devices>
Nov 07 04:14:54 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:14:54 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:14:54 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk"/>
Nov 07 04:14:54 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:14:54 user nova-compute[74540]:     </disk>
Nov 07 04:14:54 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:14:54 user nova-compute[74540]:       <mac address="fa:16:3e:79:d8:7e"/>
Nov 07 04:14:54 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:14:54 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:14:54 user nova-compute[74540]:       <target dev="tapa81b28d3-91"/>
Nov 07 04:14:54 user nova-compute[74540]:     </interface>
Nov 07 04:14:54 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:14:54 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/console.log" append="off"/>
Nov 07 04:14:54 user nova-compute[74540]:     </serial>
Nov 07 04:14:54 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:14:54 user nova-compute[74540]:     <video>
Nov 07 04:14:54 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:14:54 user nova-compute[74540]:     </video>
Nov 07 04:14:54 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:14:54 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:14:54 user nova-compute[74540]:     </rng>
Nov 07 04:14:54 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:14:54 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:14:54 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:14:54 user nova-compute[74540]:     </memballoon>
Nov 07 04:14:54 user nova-compute[74540]:   </devices>
Nov 07 04:14:54 user nova-compute[74540]: </domain>
Nov 07 04:14:54 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1083884345',display_name='tempest-VolumesActionsTest-instance-1083884345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1083884345',id=32,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc7db70c9ecb4ec9bee371401852de5e',ramdisk_id='',reservation_id='r-85ptj6fu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-885401094',owner_user_name='tempest-VolumesActionsTest-885401094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:14:53Z,user_data=None,user_id='2b4e00e8bf1c48a99a973405f8d55237',uuid=93ecf822-fcd9-41cc-97a3-3b92a49571da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a81b28d3-914c-4570-a633-b062f9e351e6", "address": "fa:16:3e:79:d8:7e", "network": {"id": "6e71c4f4-8055-40f3-bc5f-f3c806c758f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-702351221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc7db70c9ecb4ec9bee371401852de5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b28d3-91", "ovs_interfaceid": "a81b28d3-914c-4570-a633-b062f9e351e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Converting VIF {"id": "a81b28d3-914c-4570-a633-b062f9e351e6", "address": "fa:16:3e:79:d8:7e", "network": {"id": "6e71c4f4-8055-40f3-bc5f-f3c806c758f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-702351221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc7db70c9ecb4ec9bee371401852de5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b28d3-91", "ovs_interfaceid": "a81b28d3-914c-4570-a633-b062f9e351e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:d8:7e,bridge_name='br-int',has_traffic_filtering=True,id=a81b28d3-914c-4570-a633-b062f9e351e6,network=Network(6e71c4f4-8055-40f3-bc5f-f3c806c758f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b28d3-91') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG os_vif [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:d8:7e,bridge_name='br-int',has_traffic_filtering=True,id=a81b28d3-914c-4570-a633-b062f9e351e6,network=Network(6e71c4f4-8055-40f3-bc5f-f3c806c758f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b28d3-91') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06c96701-24ba-591a-9281-4909c4de10b6', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa81b28d3-91, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa81b28d3-91, col_values=(('qos', UUID('c0e3d5a9-db3e-465d-94f4-1497f5f4c873')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa81b28d3-91, col_values=(('external_ids', {'iface-id': 'a81b28d3-914c-4570-a633-b062f9e351e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:d8:7e', 'vm-uuid': '93ecf822-fcd9-41cc-97a3-3b92a49571da'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:14:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:14:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:55 user nova-compute[74540]: INFO os_vif [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:d8:7e,bridge_name='br-int',has_traffic_filtering=True,id=a81b28d3-914c-4570-a633-b062f9e351e6,network=Network(6e71c4f4-8055-40f3-bc5f-f3c806c758f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b28d3-91')
Nov 07 04:14:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:14:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] No VIF found with MAC fa:16:3e:79:d8:7e, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:14:55 user nova-compute[74540]: DEBUG nova.network.neutron [req-f53aad7f-7fc8-4fda-9de4-f8901ea46f68 req-3d8ab7da-bd8b-49c8-a788-e4ac66aa7b58 service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Updated VIF entry in instance network info cache for port a81b28d3-914c-4570-a633-b062f9e351e6. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:14:55 user nova-compute[74540]: DEBUG nova.network.neutron [req-f53aad7f-7fc8-4fda-9de4-f8901ea46f68 req-3d8ab7da-bd8b-49c8-a788-e4ac66aa7b58 service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Updating instance_info_cache with network_info: [{"id": "a81b28d3-914c-4570-a633-b062f9e351e6", "address": "fa:16:3e:79:d8:7e", "network": {"id": "6e71c4f4-8055-40f3-bc5f-f3c806c758f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-702351221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc7db70c9ecb4ec9bee371401852de5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b28d3-91", "ovs_interfaceid": "a81b28d3-914c-4570-a633-b062f9e351e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:14:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f53aad7f-7fc8-4fda-9de4-f8901ea46f68 req-3d8ab7da-bd8b-49c8-a788-e4ac66aa7b58 service nova] Releasing lock "refresh_cache-93ecf822-fcd9-41cc-97a3-3b92a49571da" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:14:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-0ad58faa-ef82-42aa-9f91-b92964fb5d95 req-afc7ae31-a16f-4b7b-b35f-33d181f8750c service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Received event network-vif-plugged-a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0ad58faa-ef82-42aa-9f91-b92964fb5d95 req-afc7ae31-a16f-4b7b-b35f-33d181f8750c service nova] Acquiring lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0ad58faa-ef82-42aa-9f91-b92964fb5d95 req-afc7ae31-a16f-4b7b-b35f-33d181f8750c service nova] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0ad58faa-ef82-42aa-9f91-b92964fb5d95 req-afc7ae31-a16f-4b7b-b35f-33d181f8750c service nova] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-0ad58faa-ef82-42aa-9f91-b92964fb5d95 req-afc7ae31-a16f-4b7b-b35f-33d181f8750c service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] No waiting events found dispatching network-vif-plugged-a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:56 user nova-compute[74540]: WARNING nova.compute.manager [req-0ad58faa-ef82-42aa-9f91-b92964fb5d95 req-afc7ae31-a16f-4b7b-b35f-33d181f8750c service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Received unexpected event network-vif-plugged-a81b28d3-914c-4570-a633-b062f9e351e6 for instance with vm_state building and task_state spawning.
Nov 07 04:14:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:14:58 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Instance spawned successfully.
Nov 07 04:14:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:14:58 user nova-compute[74540]: INFO nova.compute.manager [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 07 04:14:58 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-2ab07cf1-38fe-4262-973b-189cb67e4506 req-b9bb4045-a008-459e-8eae-3e1c5bc475c8 service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Received event network-vif-plugged-a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-2ab07cf1-38fe-4262-973b-189cb67e4506 req-b9bb4045-a008-459e-8eae-3e1c5bc475c8 service nova] Acquiring lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-2ab07cf1-38fe-4262-973b-189cb67e4506 req-b9bb4045-a008-459e-8eae-3e1c5bc475c8 service nova] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-2ab07cf1-38fe-4262-973b-189cb67e4506 req-b9bb4045-a008-459e-8eae-3e1c5bc475c8 service nova] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-2ab07cf1-38fe-4262-973b-189cb67e4506 req-b9bb4045-a008-459e-8eae-3e1c5bc475c8 service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] No waiting events found dispatching network-vif-plugged-a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:14:58 user nova-compute[74540]: WARNING nova.compute.manager [req-2ab07cf1-38fe-4262-973b-189cb67e4506 req-b9bb4045-a008-459e-8eae-3e1c5bc475c8 service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Received unexpected event network-vif-plugged-a81b28d3-914c-4570-a633-b062f9e351e6 for instance with vm_state building and task_state spawning.
Nov 07 04:14:58 user nova-compute[74540]: INFO nova.compute.manager [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Took 6.04 seconds to build instance.
Nov 07 04:14:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0871d8ac-e44b-4b8c-bb70-27723d83fae2 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.134s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:14:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:59 user nova-compute[74540]: INFO nova.compute.manager [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Unshelving
Nov 07 04:14:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:14:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:14:59 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'pci_requests' on Instance uuid dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:14:59 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'numa_topology' on Instance uuid dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:14:59 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:14:59 user nova-compute[74540]: INFO nova.compute.claims [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Claim successful on node user
Nov 07 04:15:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.compute.manager [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:15:00 user nova-compute[74540]: INFO nova.network.neutron [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updating port f06d373b-0587-4432-9c3b-8da8b7a99dac with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:15:00 user nova-compute[74540]: INFO nova.compute.claims [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Claim successful on node user
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.compute.manager [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.compute.manager [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.network.neutron [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:15:00 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.compute.manager [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquired lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.policy [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '791771e33e0645d6b97cef52f84d8b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513e7858a1b34aa2bd5f363696b38f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-75c464e4-0031-49dd-b020-ffc6e1f61f72 req-ded94044-c66c-4917-afa3-7ec3c384b56e service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-changed-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-75c464e4-0031-49dd-b020-ffc6e1f61f72 req-ded94044-c66c-4917-afa3-7ec3c384b56e service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Refreshing instance network info cache due to event network-changed-f06d373b-0587-4432-9c3b-8da8b7a99dac. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:15:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-75c464e4-0031-49dd-b020-ffc6e1f61f72 req-ded94044-c66c-4917-afa3-7ec3c384b56e service nova] Acquiring lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG nova.compute.manager [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:15:01 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Creating image(s)
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "/opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "/opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "/opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.216s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updating instance_info_cache with network_info: [{"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk 1073741824" returned: 0 in 0.069s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Releasing lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:15:01 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Creating image(s)
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "/opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "/opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'trusted_certs' on Instance uuid dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-75c464e4-0031-49dd-b020-ffc6e1f61f72 req-ded94044-c66c-4917-afa3-7ec3c384b56e service nova] Acquired lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG nova.network.neutron [req-75c464e4-0031-49dd-b020-ffc6e1f61f72 req-ded94044-c66c-4917-afa3-7ec3c384b56e service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Refreshing network info cache for port f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG nova.objects.base [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Object Instance<dc24a0b7-ff3c-482c-b0c5-0dcd70dda367> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "15a0999fd209bcc06b0d12a21aee3cf9f09624f5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "15a0999fd209bcc06b0d12a21aee3cf9f09624f5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:01 user nova-compute[74540]: DEBUG nova.network.neutron [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Successfully created port: b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5.part --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:02 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 is timed out.
Nov 07 04:15:02 user nova-compute[74540]: DEBUG nova.network.neutron [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Successfully updated port: b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-9742fe84-6d99-4649-87f6-eaa93bf7dcf5 req-4232dd38-06ab-4aae-86af-9dad1ce73a5c service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Received event network-changed-b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-9742fe84-6d99-4649-87f6-eaa93bf7dcf5 req-4232dd38-06ab-4aae-86af-9dad1ce73a5c service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Refreshing instance network info cache due to event network-changed-b3db2639-3be8-4213-88a7-7295fad36c80. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9742fe84-6d99-4649-87f6-eaa93bf7dcf5 req-4232dd38-06ab-4aae-86af-9dad1ce73a5c service nova] Acquiring lock "refresh_cache-60104cc3-faf7-408c-8b95-7195ad105d3b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9742fe84-6d99-4649-87f6-eaa93bf7dcf5 req-4232dd38-06ab-4aae-86af-9dad1ce73a5c service nova] Acquired lock "refresh_cache-60104cc3-faf7-408c-8b95-7195ad105d3b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG nova.network.neutron [req-9742fe84-6d99-4649-87f6-eaa93bf7dcf5 req-4232dd38-06ab-4aae-86af-9dad1ce73a5c service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Refreshing network info cache for port b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:15:02 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Successfully detached device vdb from instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 from the live domain config.
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 1.225s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "refresh_cache-60104cc3-faf7-408c-8b95-7195ad105d3b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vAMCHUYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:15:02 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:15:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[31847500-e346-4b6e-9dca-151921d09035]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:15:02 user nova-compute[74540]: No targets found.
Nov 07 04:15:02 user nova-compute[74540]: iSNS:
Nov 07 04:15:02 user nova-compute[74540]: No targets found.
Nov 07 04:15:02 user nova-compute[74540]: STATIC:
Nov 07 04:15:02 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1
Nov 07 04:15:02 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:15:02 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:15:02 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f
Nov 07 04:15:02 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:15:02 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:15:02 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:15:02 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:15:02 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:15:02 user nova-compute[74540]: FIRMWARE:
Nov 07 04:15:02 user nova-compute[74540]: No targets found.
Nov 07 04:15:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:15:02 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:15:02 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG nova.network.neutron [req-9742fe84-6d99-4649-87f6-eaa93bf7dcf5 req-4232dd38-06ab-4aae-86af-9dad1ce73a5c service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5.part --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG nova.virt.images [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] cc2c7051-2332-48e3-bd59-f83096f7ad92 was qcow2, converting to raw {{(pid=74540) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5.part /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5.converted {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fc99c9-7d6b-4eb5-907e-d2b273b1b0e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Cannot resize image /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Ensure instance console log exists: /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[db928d83-e4fc-4aef-97bc-29c654a60840]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:15:02 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:15:02 user nova-compute[74540]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f (non-flash)
Nov 07 04:15:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:15:02 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:15:02 user nova-compute[74540]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f (non-flash)
Nov 07 04:15:02 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc23a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[deec08a7-5d70-45d8-8563-04f968acc248]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.040s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00bba48-cda6-453c-a3de-1a00f87ea4dd]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d254623f-8706-4d95-94a2-06a3854f05a4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.network.neutron [req-9742fe84-6d99-4649-87f6-eaa93bf7dcf5 req-4232dd38-06ab-4aae-86af-9dad1ce73a5c service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[61212666-b008-49ef-9f6d-f7ef5147e823]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9742fe84-6d99-4649-87f6-eaa93bf7dcf5 req-4232dd38-06ab-4aae-86af-9dad1ce73a5c service nova] Releasing lock "refresh_cache-60104cc3-faf7-408c-8b95-7195ad105d3b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquired lock "refresh_cache-60104cc3-faf7-408c-8b95-7195ad105d3b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.network.neutron [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.network.neutron [req-75c464e4-0031-49dd-b020-ffc6e1f61f72 req-ded94044-c66c-4917-afa3-7ec3c384b56e service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updated VIF entry in instance network info cache for port f06d373b-0587-4432-9c3b-8da8b7a99dac. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.network.neutron [req-75c464e4-0031-49dd-b020-ffc6e1f61f72 req-ded94044-c66c-4917-afa3-7ec3c384b56e service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updating instance_info_cache with network_info: [{"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.067s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[94662c94-8ff5-448d-9780-d740cee21604]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-75c464e4-0031-49dd-b020-ffc6e1f61f72 req-ded94044-c66c-4917-afa3-7ec3c384b56e service nova] Releasing lock "refresh_cache-dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.network.neutron [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5.part /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5.converted" returned: 0 in 0.382s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5.converted --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d2768d-1027-4630-a3e7-cf193e37a456]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f, portal: 172.16.0.220,3260]
Nov 07 04:15:03 user nova-compute[74540]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f, portal: 172.16.0.220,3260] successful.
Nov 07 04:15:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78af54fb-8bec-4dfd-973f-35c91a08c73f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93f9ed0-dd1c-4ef0-840e-338de978591a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.547s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] <== disconnect_volume: return (549ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "15a0999fd209bcc06b0d12a21aee3cf9f09624f5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.860s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.network.neutron [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Updating instance_info_cache with network_info: [{"id": "b3db2639-3be8-4213-88a7-7295fad36c80", "address": "fa:16:3e:35:18:90", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3db2639-3b", "ovs_interfaceid": "b3db2639-3be8-4213-88a7-7295fad36c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Releasing lock "refresh_cache-60104cc3-faf7-408c-8b95-7195ad105d3b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.compute.manager [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Instance network_info: |[{"id": "b3db2639-3be8-4213-88a7-7295fad36c80", "address": "fa:16:3e:35:18:90", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3db2639-3b", "ovs_interfaceid": "b3db2639-3be8-4213-88a7-7295fad36c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Start _get_guest_xml network_info=[{"id": "b3db2639-3be8-4213-88a7-7295fad36c80", "address": "fa:16:3e:35:18:90", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3db2639-3b", "ovs_interfaceid": "b3db2639-3be8-4213-88a7-7295fad36c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:15:03 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:03 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1371522689',display_name='tempest-AttachVolumeTestJSON-server-1371522689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1371522689',id=33,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtViIuNrGVxr8xa1CIVo8HTFs2rbXYriIfxRBM1I/0DTP/2zS2Iu04jvtOWjBJwP0VNJBn8BlqJQAY0TVtpVmRWwmSZp97yg80kjIGbXeMuabtCks8o/oK5CTLIM6qW8w==',key_name='tempest-keypair-729933638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513e7858a1b34aa2bd5f363696b38f0a',ramdisk_id='',reservation_id='r-s1o5p2vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-540287196',owner_user_name='tempest-AttachVolumeTestJSON-540287196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='791771e33e0645d6b97cef52f84d8b9c',uuid=60104cc3-faf7-408c-8b95-7195ad105d3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3db2639-3be8-4213-88a7-7295fad36c80", "address": "fa:16:3e:35:18:90", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3db2639-3b", "ovs_interfaceid": "b3db2639-3be8-4213-88a7-7295fad36c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converting VIF {"id": "b3db2639-3be8-4213-88a7-7295fad36c80", "address": "fa:16:3e:35:18:90", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3db2639-3b", "ovs_interfaceid": "b3db2639-3be8-4213-88a7-7295fad36c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:18:90,bridge_name='br-int',has_traffic_filtering=True,id=b3db2639-3be8-4213-88a7-7295fad36c80,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3db2639-3b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.objects.instance [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'pci_devices' on Instance uuid 60104cc3-faf7-408c-8b95-7195ad105d3b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:15:03 user nova-compute[74540]:   <uuid>60104cc3-faf7-408c-8b95-7195ad105d3b</uuid>
Nov 07 04:15:03 user nova-compute[74540]:   <name>instance-00000021</name>
Nov 07 04:15:03 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:15:03 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:15:03 user nova-compute[74540]:   <metadata>
Nov 07 04:15:03 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:15:03 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:15:03 user nova-compute[74540]:       <nova:name>tempest-AttachVolumeTestJSON-server-1371522689</nova:name>
Nov 07 04:15:03 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:15:03</nova:creationTime>
Nov 07 04:15:03 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:15:03 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:15:03 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:15:03 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:15:03 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:15:03 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:15:03 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:15:03 user nova-compute[74540]:       <nova:owner>
Nov 07 04:15:03 user nova-compute[74540]:         <nova:user uuid="791771e33e0645d6b97cef52f84d8b9c">tempest-AttachVolumeTestJSON-540287196-project-member</nova:user>
Nov 07 04:15:03 user nova-compute[74540]:         <nova:project uuid="513e7858a1b34aa2bd5f363696b38f0a">tempest-AttachVolumeTestJSON-540287196</nova:project>
Nov 07 04:15:03 user nova-compute[74540]:       </nova:owner>
Nov 07 04:15:03 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:15:03 user nova-compute[74540]:       <nova:ports>
Nov 07 04:15:03 user nova-compute[74540]:         <nova:port uuid="b3db2639-3be8-4213-88a7-7295fad36c80">
Nov 07 04:15:03 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 04:15:03 user nova-compute[74540]:         </nova:port>
Nov 07 04:15:03 user nova-compute[74540]:       </nova:ports>
Nov 07 04:15:03 user nova-compute[74540]:     </nova:instance>
Nov 07 04:15:03 user nova-compute[74540]:   </metadata>
Nov 07 04:15:03 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:15:03 user nova-compute[74540]:     <system>
Nov 07 04:15:03 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:15:03 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:15:03 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:15:03 user nova-compute[74540]:       <entry name="serial">60104cc3-faf7-408c-8b95-7195ad105d3b</entry>
Nov 07 04:15:03 user nova-compute[74540]:       <entry name="uuid">60104cc3-faf7-408c-8b95-7195ad105d3b</entry>
Nov 07 04:15:03 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:15:03 user nova-compute[74540]:     </system>
Nov 07 04:15:03 user nova-compute[74540]:   </sysinfo>
Nov 07 04:15:03 user nova-compute[74540]:   <os>
Nov 07 04:15:03 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:15:03 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:15:03 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:15:03 user nova-compute[74540]:   </os>
Nov 07 04:15:03 user nova-compute[74540]:   <features>
Nov 07 04:15:03 user nova-compute[74540]:     <acpi/>
Nov 07 04:15:03 user nova-compute[74540]:     <apic/>
Nov 07 04:15:03 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:15:03 user nova-compute[74540]:   </features>
Nov 07 04:15:03 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:15:03 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:15:03 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:15:03 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:15:03 user nova-compute[74540]:   </clock>
Nov 07 04:15:03 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:15:03 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:15:03 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:15:03 user nova-compute[74540]:   </cpu>
Nov 07 04:15:03 user nova-compute[74540]:   <devices>
Nov 07 04:15:03 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:15:03 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:15:03 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk"/>
Nov 07 04:15:03 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:15:03 user nova-compute[74540]:     </disk>
Nov 07 04:15:03 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:15:03 user nova-compute[74540]:       <mac address="fa:16:3e:35:18:90"/>
Nov 07 04:15:03 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:15:03 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:15:03 user nova-compute[74540]:       <target dev="tapb3db2639-3b"/>
Nov 07 04:15:03 user nova-compute[74540]:     </interface>
Nov 07 04:15:03 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:15:03 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/console.log" append="off"/>
Nov 07 04:15:03 user nova-compute[74540]:     </serial>
Nov 07 04:15:03 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:15:03 user nova-compute[74540]:     <video>
Nov 07 04:15:03 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:15:03 user nova-compute[74540]:     </video>
Nov 07 04:15:03 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:15:03 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:15:03 user nova-compute[74540]:     </rng>
Nov 07 04:15:03 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:15:03 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:15:03 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:15:03 user nova-compute[74540]:     </memballoon>
Nov 07 04:15:03 user nova-compute[74540]:   </devices>
Nov 07 04:15:03 user nova-compute[74540]: </domain>
Nov 07 04:15:03 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1371522689',display_name='tempest-AttachVolumeTestJSON-server-1371522689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1371522689',id=33,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtViIuNrGVxr8xa1CIVo8HTFs2rbXYriIfxRBM1I/0DTP/2zS2Iu04jvtOWjBJwP0VNJBn8BlqJQAY0TVtpVmRWwmSZp97yg80kjIGbXeMuabtCks8o/oK5CTLIM6qW8w==',key_name='tempest-keypair-729933638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513e7858a1b34aa2bd5f363696b38f0a',ramdisk_id='',reservation_id='r-s1o5p2vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-540287196',owner_user_name='tempest-AttachVolumeTestJSON-540287196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='791771e33e0645d6b97cef52f84d8b9c',uuid=60104cc3-faf7-408c-8b95-7195ad105d3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3db2639-3be8-4213-88a7-7295fad36c80", "address": "fa:16:3e:35:18:90", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3db2639-3b", "ovs_interfaceid": "b3db2639-3be8-4213-88a7-7295fad36c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converting VIF {"id": "b3db2639-3be8-4213-88a7-7295fad36c80", "address": "fa:16:3e:35:18:90", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3db2639-3b", "ovs_interfaceid": "b3db2639-3be8-4213-88a7-7295fad36c80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:18:90,bridge_name='br-int',has_traffic_filtering=True,id=b3db2639-3be8-4213-88a7-7295fad36c80,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3db2639-3b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG os_vif [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:18:90,bridge_name='br-int',has_traffic_filtering=True,id=b3db2639-3be8-4213-88a7-7295fad36c80,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3db2639-3b') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a55f0fd-20cb-53d5-8d11-628af736ee19', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5 --force-share --output=json" returned: 0 in 0.204s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "15a0999fd209bcc06b0d12a21aee3cf9f09624f5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "15a0999fd209bcc06b0d12a21aee3cf9f09624f5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3db2639-3b, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3db2639-3b, col_values=(('qos', UUID('dd2e9b28-41c3-4243-8618-255c83a738a9')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3db2639-3b, col_values=(('external_ids', {'iface-id': 'b3db2639-3be8-4213-88a7-7295fad36c80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:18:90', 'vm-uuid': '60104cc3-faf7-408c-8b95-7195ad105d3b'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:03 user nova-compute[74540]: INFO os_vif [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:18:90,bridge_name='br-int',has_traffic_filtering=True,id=b3db2639-3be8-4213-88a7-7295fad36c80,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3db2639-3b')
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No VIF found with MAC fa:16:3e:35:18:90, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5 --force-share --output=json" returned: 0 in 0.212s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5,backing_fmt=raw /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5,backing_fmt=raw /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk 1073741824" returned: 0 in 0.057s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "15a0999fd209bcc06b0d12a21aee3cf9f09624f5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5 --force-share --output=json" returned: 0 in 0.232s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:04 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'migration_context' on Instance uuid dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:15:04 user nova-compute[74540]: DEBUG nova.objects.base [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Object Instance<dc24a0b7-ff3c-482c-b0c5-0dcd70dda367> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:15:04 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Rebasing disk image.
Nov 07 04:15:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:04 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lazy-loading 'flavor' on Instance uuid cc15c8fc-e47f-4df0-94ec-8daeacb112c9 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:15:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f6cc770e-2d49-4c36-94b8-bdd515ea5dc2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.058s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c -F raw /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-1707fcf1-fe26-488f-826f-7a67fc2cc24e req-15da14c3-bf65-4d9b-bf13-43347e4b2010 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Received event network-vif-plugged-b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1707fcf1-fe26-488f-826f-7a67fc2cc24e req-15da14c3-bf65-4d9b-bf13-43347e4b2010 service nova] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1707fcf1-fe26-488f-826f-7a67fc2cc24e req-15da14c3-bf65-4d9b-bf13-43347e4b2010 service nova] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1707fcf1-fe26-488f-826f-7a67fc2cc24e req-15da14c3-bf65-4d9b-bf13-43347e4b2010 service nova] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-1707fcf1-fe26-488f-826f-7a67fc2cc24e req-15da14c3-bf65-4d9b-bf13-43347e4b2010 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] No waiting events found dispatching network-vif-plugged-b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:15:05 user nova-compute[74540]: WARNING nova.compute.manager [req-1707fcf1-fe26-488f-826f-7a67fc2cc24e req-15da14c3-bf65-4d9b-bf13-43347e4b2010 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Received unexpected event network-vif-plugged-b3db2639-3be8-4213-88a7-7295fad36c80 for instance with vm_state building and task_state spawning.
Nov 07 04:15:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c -F raw /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk" returned: 0 in 2.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Ensure instance console log exists: /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Start _get_guest_xml network_info=[{"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='987d6ba53d484fadcac24a8b9d355ab1',container_format='bare',created_at=2023-11-07T04:13:06Z,direct_url=<?>,disk_format='qcow2',id=cc2c7051-2332-48e3-bd59-f83096f7ad92,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1746250716-shelved',owner='796865203135404b8624363d533ae6fe',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-07T04:13:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:15:06 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:06 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='987d6ba53d484fadcac24a8b9d355ab1',container_format='bare',created_at=2023-11-07T04:13:06Z,direct_url=<?>,disk_format='qcow2',id=cc2c7051-2332-48e3-bd59-f83096f7ad92,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1746250716-shelved',owner='796865203135404b8624363d533ae6fe',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-07T04:13:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.objects.base [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Object Instance<dc24a0b7-ff3c-482c-b0c5-0dcd70dda367> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T04:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746250716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746250716',id=28,image_ref='cc2c7051-2332-48e3-bd59-f83096f7ad92',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-24688172',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='796865203135404b8624363d533ae6fe',ramdisk_id='',reservation_id='r-oora9sqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952443794',owner_user_name='tempest-AttachVolumeShelveTestJSON-952443794-project-member',shelved_at='2023-11-07T04:13:11.259893',shelved_host='user',shelved_image_id='cc2c7051-2332-48e3-bd59-f83096f7ad92'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fad238078941dba4cc57406b1c69ed',uuid=dc24a0b7-ff3c-482c-b0c5-0dcd70dda367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converting VIF {"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'pci_devices' on Instance uuid dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.objects.base [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Object Instance<dc24a0b7-ff3c-482c-b0c5-0dcd70dda367> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:15:06 user nova-compute[74540]:   <uuid>dc24a0b7-ff3c-482c-b0c5-0dcd70dda367</uuid>
Nov 07 04:15:06 user nova-compute[74540]:   <name>instance-0000001c</name>
Nov 07 04:15:06 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:15:06 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:15:06 user nova-compute[74540]:   <metadata>
Nov 07 04:15:06 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:15:06 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:15:06 user nova-compute[74540]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1746250716</nova:name>
Nov 07 04:15:06 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:15:06</nova:creationTime>
Nov 07 04:15:06 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:15:06 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:15:06 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:15:06 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:15:06 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:15:06 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:15:06 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:15:06 user nova-compute[74540]:       <nova:owner>
Nov 07 04:15:06 user nova-compute[74540]:         <nova:user uuid="47fad238078941dba4cc57406b1c69ed">tempest-AttachVolumeShelveTestJSON-952443794-project-member</nova:user>
Nov 07 04:15:06 user nova-compute[74540]:         <nova:project uuid="796865203135404b8624363d533ae6fe">tempest-AttachVolumeShelveTestJSON-952443794</nova:project>
Nov 07 04:15:06 user nova-compute[74540]:       </nova:owner>
Nov 07 04:15:06 user nova-compute[74540]:       <nova:root type="image" uuid="cc2c7051-2332-48e3-bd59-f83096f7ad92"/>
Nov 07 04:15:06 user nova-compute[74540]:       <nova:ports>
Nov 07 04:15:06 user nova-compute[74540]:         <nova:port uuid="f06d373b-0587-4432-9c3b-8da8b7a99dac">
Nov 07 04:15:06 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 07 04:15:06 user nova-compute[74540]:         </nova:port>
Nov 07 04:15:06 user nova-compute[74540]:       </nova:ports>
Nov 07 04:15:06 user nova-compute[74540]:     </nova:instance>
Nov 07 04:15:06 user nova-compute[74540]:   </metadata>
Nov 07 04:15:06 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:15:06 user nova-compute[74540]:     <system>
Nov 07 04:15:06 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:15:06 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:15:06 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:15:06 user nova-compute[74540]:       <entry name="serial">dc24a0b7-ff3c-482c-b0c5-0dcd70dda367</entry>
Nov 07 04:15:06 user nova-compute[74540]:       <entry name="uuid">dc24a0b7-ff3c-482c-b0c5-0dcd70dda367</entry>
Nov 07 04:15:06 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:15:06 user nova-compute[74540]:     </system>
Nov 07 04:15:06 user nova-compute[74540]:   </sysinfo>
Nov 07 04:15:06 user nova-compute[74540]:   <os>
Nov 07 04:15:06 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:15:06 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:15:06 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:15:06 user nova-compute[74540]:   </os>
Nov 07 04:15:06 user nova-compute[74540]:   <features>
Nov 07 04:15:06 user nova-compute[74540]:     <acpi/>
Nov 07 04:15:06 user nova-compute[74540]:     <apic/>
Nov 07 04:15:06 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:15:06 user nova-compute[74540]:   </features>
Nov 07 04:15:06 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:15:06 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:15:06 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:15:06 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:15:06 user nova-compute[74540]:   </clock>
Nov 07 04:15:06 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:15:06 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:15:06 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:15:06 user nova-compute[74540]:   </cpu>
Nov 07 04:15:06 user nova-compute[74540]:   <devices>
Nov 07 04:15:06 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:15:06 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:15:06 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk"/>
Nov 07 04:15:06 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:15:06 user nova-compute[74540]:     </disk>
Nov 07 04:15:06 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:15:06 user nova-compute[74540]:       <mac address="fa:16:3e:7e:23:61"/>
Nov 07 04:15:06 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:15:06 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:15:06 user nova-compute[74540]:       <target dev="tapf06d373b-05"/>
Nov 07 04:15:06 user nova-compute[74540]:     </interface>
Nov 07 04:15:06 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:15:06 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/console.log" append="off"/>
Nov 07 04:15:06 user nova-compute[74540]:     </serial>
Nov 07 04:15:06 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:15:06 user nova-compute[74540]:     <video>
Nov 07 04:15:06 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:15:06 user nova-compute[74540]:     </video>
Nov 07 04:15:06 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:15:06 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:15:06 user nova-compute[74540]:     </rng>
Nov 07 04:15:06 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:15:06 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:15:06 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:15:06 user nova-compute[74540]:     </memballoon>
Nov 07 04:15:06 user nova-compute[74540]:   </devices>
Nov 07 04:15:06 user nova-compute[74540]: </domain>
Nov 07 04:15:06 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T04:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746250716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746250716',id=28,image_ref='cc2c7051-2332-48e3-bd59-f83096f7ad92',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-24688172',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='796865203135404b8624363d533ae6fe',ramdisk_id='',reservation_id='r-oora9sqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952443794',owner_user_name='tempest-AttachVolumeShelveTestJSON-952443794-project-member',shelved_at='2023-11-07T04:13:11.259893',shelved_host='user',shelved_image_id='cc2c7051-2332-48e3-bd59-f83096f7ad92'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fad238078941dba4cc57406b1c69ed',uuid=dc24a0b7-ff3c-482c-b0c5-0dcd70dda367,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converting VIF {"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG os_vif [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af54b29e-7839-56c0-a182-214ad139f561', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf06d373b-05, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf06d373b-05, col_values=(('qos', UUID('75024f53-45b9-41cd-a56d-f87541812522')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf06d373b-05, col_values=(('external_ids', {'iface-id': 'f06d373b-0587-4432-9c3b-8da8b7a99dac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:23:61', 'vm-uuid': 'dc24a0b7-ff3c-482c-b0c5-0dcd70dda367'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:06 user nova-compute[74540]: INFO os_vif [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05')
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:15:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] No VIF found with MAC fa:16:3e:7e:23:61, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:15:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-d695ff14-2b54-4b33-b917-a4fc378e2268 req-8bd8c22d-f6ae-47a4-bba2-e596e18d8d45 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Received event network-vif-plugged-b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d695ff14-2b54-4b33-b917-a4fc378e2268 req-8bd8c22d-f6ae-47a4-bba2-e596e18d8d45 service nova] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d695ff14-2b54-4b33-b917-a4fc378e2268 req-8bd8c22d-f6ae-47a4-bba2-e596e18d8d45 service nova] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d695ff14-2b54-4b33-b917-a4fc378e2268 req-8bd8c22d-f6ae-47a4-bba2-e596e18d8d45 service nova] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-d695ff14-2b54-4b33-b917-a4fc378e2268 req-8bd8c22d-f6ae-47a4-bba2-e596e18d8d45 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] No waiting events found dispatching network-vif-plugged-b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:15:07 user nova-compute[74540]: WARNING nova.compute.manager [req-d695ff14-2b54-4b33-b917-a4fc378e2268 req-8bd8c22d-f6ae-47a4-bba2-e596e18d8d45 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Received unexpected event network-vif-plugged-b3db2639-3be8-4213-88a7-7295fad36c80 for instance with vm_state building and task_state spawning.
Nov 07 04:15:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:15:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:15:07 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Instance spawned successfully.
Nov 07 04:15:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:15:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:07 user nova-compute[74540]: INFO nova.compute.manager [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Took 6.88 seconds to spawn the instance on the hypervisor.
Nov 07 04:15:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:15:07 user nova-compute[74540]: INFO nova.compute.manager [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Took 7.66 seconds to build instance.
Nov 07 04:15:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3d734069-64b0-4f4c-9a62-951495cdcc63 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.803s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-517c5dce-ec4f-4fde-abf5-cc34e0125888 req-495de093-ba0b-43c0-a032-a5b628313f07 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-517c5dce-ec4f-4fde-abf5-cc34e0125888 req-495de093-ba0b-43c0-a032-a5b628313f07 service nova] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-517c5dce-ec4f-4fde-abf5-cc34e0125888 req-495de093-ba0b-43c0-a032-a5b628313f07 service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-517c5dce-ec4f-4fde-abf5-cc34e0125888 req-495de093-ba0b-43c0-a032-a5b628313f07 service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-517c5dce-ec4f-4fde-abf5-cc34e0125888 req-495de093-ba0b-43c0-a032-a5b628313f07 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] No waiting events found dispatching network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:15:08 user nova-compute[74540]: WARNING nova.compute.manager [req-517c5dce-ec4f-4fde-abf5-cc34e0125888 req-495de093-ba0b-43c0-a032-a5b628313f07 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received unexpected event network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac for instance with vm_state shelved_offloaded and task_state spawning.
Nov 07 04:15:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:10 user nova-compute[74540]: DEBUG nova.compute.manager [req-ee9e0904-753a-4cda-a29d-d96868e8d802 req-df131774-37eb-4022-a12d-f7b0fa6eccb8 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ee9e0904-753a-4cda-a29d-d96868e8d802 req-df131774-37eb-4022-a12d-f7b0fa6eccb8 service nova] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ee9e0904-753a-4cda-a29d-d96868e8d802 req-df131774-37eb-4022-a12d-f7b0fa6eccb8 service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ee9e0904-753a-4cda-a29d-d96868e8d802 req-df131774-37eb-4022-a12d-f7b0fa6eccb8 service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:10 user nova-compute[74540]: DEBUG nova.compute.manager [req-ee9e0904-753a-4cda-a29d-d96868e8d802 req-df131774-37eb-4022-a12d-f7b0fa6eccb8 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] No waiting events found dispatching network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:15:10 user nova-compute[74540]: WARNING nova.compute.manager [req-ee9e0904-753a-4cda-a29d-d96868e8d802 req-df131774-37eb-4022-a12d-f7b0fa6eccb8 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received unexpected event network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac for instance with vm_state shelved_offloaded and task_state spawning.
Nov 07 04:15:10 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:15:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:15:10 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Instance spawned successfully.
Nov 07 04:15:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:15:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bfe7933-c039-4a7b-9424-4909d9fe9015 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.472s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:15:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:15:19 user nova-compute[74540]: INFO nova.compute.claims [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Claim successful on node user
Nov 07 04:15:20 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG nova.network.neutron [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:15:20 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:15:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG nova.policy [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b1fde560d4146e48532693afb044a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c4c299b1b74a68a93a3f373067051f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:15:20 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Creating image(s)
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "/opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "/opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "/opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.238s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.197s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG nova.network.neutron [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Successfully created port: 9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk 1073741824" returned: 0 in 0.070s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Cannot resize image /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Ensure instance console log exists: /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG nova.network.neutron [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Successfully updated port: 9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-f65cce56-397d-47ee-82be-5f3879620463 req-4072bbc5-d729-40fb-8d99-df4d5819d196 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Received event network-changed-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-f65cce56-397d-47ee-82be-5f3879620463 req-4072bbc5-d729-40fb-8d99-df4d5819d196 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Refreshing instance network info cache due to event network-changed-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f65cce56-397d-47ee-82be-5f3879620463 req-4072bbc5-d729-40fb-8d99-df4d5819d196 service nova] Acquiring lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f65cce56-397d-47ee-82be-5f3879620463 req-4072bbc5-d729-40fb-8d99-df4d5819d196 service nova] Acquired lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG nova.network.neutron [req-f65cce56-397d-47ee-82be-5f3879620463 req-4072bbc5-d729-40fb-8d99-df4d5819d196 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Refreshing network info cache for port ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "refresh_cache-eab83056-14bd-4dd3-bcd0-7bc25cb8f722" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquired lock "refresh_cache-eab83056-14bd-4dd3-bcd0-7bc25cb8f722" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG nova.network.neutron [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-0a9241f3-60ce-42d9-bbc8-572685fbafc4 req-5f4702d7-3788-4bce-833c-401563feb45c service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Received event network-changed-9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-0a9241f3-60ce-42d9-bbc8-572685fbafc4 req-5f4702d7-3788-4bce-833c-401563feb45c service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Refreshing instance network info cache due to event network-changed-9635f951-17ba-47fc-91d9-105fca414382. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0a9241f3-60ce-42d9-bbc8-572685fbafc4 req-5f4702d7-3788-4bce-833c-401563feb45c service nova] Acquiring lock "refresh_cache-eab83056-14bd-4dd3-bcd0-7bc25cb8f722" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:21 user nova-compute[74540]: DEBUG nova.network.neutron [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Updating instance_info_cache with network_info: [{"id": "9635f951-17ba-47fc-91d9-105fca414382", "address": "fa:16:3e:74:86:27", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9635f951-17", "ovs_interfaceid": "9635f951-17ba-47fc-91d9-105fca414382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.network.neutron [req-f65cce56-397d-47ee-82be-5f3879620463 req-4072bbc5-d729-40fb-8d99-df4d5819d196 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updated VIF entry in instance network info cache for port ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.network.neutron [req-f65cce56-397d-47ee-82be-5f3879620463 req-4072bbc5-d729-40fb-8d99-df4d5819d196 service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updating instance_info_cache with network_info: [{"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Releasing lock "refresh_cache-eab83056-14bd-4dd3-bcd0-7bc25cb8f722" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Instance network_info: |[{"id": "9635f951-17ba-47fc-91d9-105fca414382", "address": "fa:16:3e:74:86:27", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9635f951-17", "ovs_interfaceid": "9635f951-17ba-47fc-91d9-105fca414382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0a9241f3-60ce-42d9-bbc8-572685fbafc4 req-5f4702d7-3788-4bce-833c-401563feb45c service nova] Acquired lock "refresh_cache-eab83056-14bd-4dd3-bcd0-7bc25cb8f722" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.network.neutron [req-0a9241f3-60ce-42d9-bbc8-572685fbafc4 req-5f4702d7-3788-4bce-833c-401563feb45c service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Refreshing network info cache for port 9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Start _get_guest_xml network_info=[{"id": "9635f951-17ba-47fc-91d9-105fca414382", "address": "fa:16:3e:74:86:27", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9635f951-17", "ovs_interfaceid": "9635f951-17ba-47fc-91d9-105fca414382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f65cce56-397d-47ee-82be-5f3879620463 req-4072bbc5-d729-40fb-8d99-df4d5819d196 service nova] Releasing lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:22 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:22 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-478997355',display_name='tempest-ServersNegativeTestJSON-server-478997355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-478997355',id=34,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c4c299b1b74a68a93a3f373067051f',ramdisk_id='',reservation_id='r-qvk0voe4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-640893805',owner_user_name='tempest-ServersNegativeTestJSON-640893805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:20Z,user_data=None,user_id='8b1fde560d4146e48532693afb044a41',uuid=eab83056-14bd-4dd3-bcd0-7bc25cb8f722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9635f951-17ba-47fc-91d9-105fca414382", "address": "fa:16:3e:74:86:27", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9635f951-17", "ovs_interfaceid": "9635f951-17ba-47fc-91d9-105fca414382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Converting VIF {"id": "9635f951-17ba-47fc-91d9-105fca414382", "address": "fa:16:3e:74:86:27", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9635f951-17", "ovs_interfaceid": "9635f951-17ba-47fc-91d9-105fca414382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:86:27,bridge_name='br-int',has_traffic_filtering=True,id=9635f951-17ba-47fc-91d9-105fca414382,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9635f951-17') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.objects.instance [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lazy-loading 'pci_devices' on Instance uuid eab83056-14bd-4dd3-bcd0-7bc25cb8f722 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:15:22 user nova-compute[74540]:   <uuid>eab83056-14bd-4dd3-bcd0-7bc25cb8f722</uuid>
Nov 07 04:15:22 user nova-compute[74540]:   <name>instance-00000022</name>
Nov 07 04:15:22 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:15:22 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:15:22 user nova-compute[74540]:   <metadata>
Nov 07 04:15:22 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:15:22 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:15:22 user nova-compute[74540]:       <nova:name>tempest-ServersNegativeTestJSON-server-478997355</nova:name>
Nov 07 04:15:22 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:15:22</nova:creationTime>
Nov 07 04:15:22 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:15:22 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:15:22 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:15:22 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:15:22 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:15:22 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:15:22 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:15:22 user nova-compute[74540]:       <nova:owner>
Nov 07 04:15:22 user nova-compute[74540]:         <nova:user uuid="8b1fde560d4146e48532693afb044a41">tempest-ServersNegativeTestJSON-640893805-project-member</nova:user>
Nov 07 04:15:22 user nova-compute[74540]:         <nova:project uuid="d8c4c299b1b74a68a93a3f373067051f">tempest-ServersNegativeTestJSON-640893805</nova:project>
Nov 07 04:15:22 user nova-compute[74540]:       </nova:owner>
Nov 07 04:15:22 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:15:22 user nova-compute[74540]:       <nova:ports>
Nov 07 04:15:22 user nova-compute[74540]:         <nova:port uuid="9635f951-17ba-47fc-91d9-105fca414382">
Nov 07 04:15:22 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 07 04:15:22 user nova-compute[74540]:         </nova:port>
Nov 07 04:15:22 user nova-compute[74540]:       </nova:ports>
Nov 07 04:15:22 user nova-compute[74540]:     </nova:instance>
Nov 07 04:15:22 user nova-compute[74540]:   </metadata>
Nov 07 04:15:22 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:15:22 user nova-compute[74540]:     <system>
Nov 07 04:15:22 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:15:22 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:15:22 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:15:22 user nova-compute[74540]:       <entry name="serial">eab83056-14bd-4dd3-bcd0-7bc25cb8f722</entry>
Nov 07 04:15:22 user nova-compute[74540]:       <entry name="uuid">eab83056-14bd-4dd3-bcd0-7bc25cb8f722</entry>
Nov 07 04:15:22 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:15:22 user nova-compute[74540]:     </system>
Nov 07 04:15:22 user nova-compute[74540]:   </sysinfo>
Nov 07 04:15:22 user nova-compute[74540]:   <os>
Nov 07 04:15:22 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:15:22 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:15:22 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:15:22 user nova-compute[74540]:   </os>
Nov 07 04:15:22 user nova-compute[74540]:   <features>
Nov 07 04:15:22 user nova-compute[74540]:     <acpi/>
Nov 07 04:15:22 user nova-compute[74540]:     <apic/>
Nov 07 04:15:22 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:15:22 user nova-compute[74540]:   </features>
Nov 07 04:15:22 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:15:22 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:15:22 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:15:22 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:15:22 user nova-compute[74540]:   </clock>
Nov 07 04:15:22 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:15:22 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:15:22 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:15:22 user nova-compute[74540]:   </cpu>
Nov 07 04:15:22 user nova-compute[74540]:   <devices>
Nov 07 04:15:22 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:15:22 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:15:22 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk"/>
Nov 07 04:15:22 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:15:22 user nova-compute[74540]:     </disk>
Nov 07 04:15:22 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:15:22 user nova-compute[74540]:       <mac address="fa:16:3e:74:86:27"/>
Nov 07 04:15:22 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:15:22 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:15:22 user nova-compute[74540]:       <target dev="tap9635f951-17"/>
Nov 07 04:15:22 user nova-compute[74540]:     </interface>
Nov 07 04:15:22 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:15:22 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/console.log" append="off"/>
Nov 07 04:15:22 user nova-compute[74540]:     </serial>
Nov 07 04:15:22 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:15:22 user nova-compute[74540]:     <video>
Nov 07 04:15:22 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:15:22 user nova-compute[74540]:     </video>
Nov 07 04:15:22 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:15:22 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:15:22 user nova-compute[74540]:     </rng>
Nov 07 04:15:22 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:15:22 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:15:22 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:15:22 user nova-compute[74540]:     </memballoon>
Nov 07 04:15:22 user nova-compute[74540]:   </devices>
Nov 07 04:15:22 user nova-compute[74540]: </domain>
Nov 07 04:15:22 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-478997355',display_name='tempest-ServersNegativeTestJSON-server-478997355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-478997355',id=34,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c4c299b1b74a68a93a3f373067051f',ramdisk_id='',reservation_id='r-qvk0voe4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-640893805',owner_user_name='tempest-ServersNegativeTestJSON-640893805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:20Z,user_data=None,user_id='8b1fde560d4146e48532693afb044a41',uuid=eab83056-14bd-4dd3-bcd0-7bc25cb8f722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9635f951-17ba-47fc-91d9-105fca414382", "address": "fa:16:3e:74:86:27", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9635f951-17", "ovs_interfaceid": "9635f951-17ba-47fc-91d9-105fca414382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Converting VIF {"id": "9635f951-17ba-47fc-91d9-105fca414382", "address": "fa:16:3e:74:86:27", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9635f951-17", "ovs_interfaceid": "9635f951-17ba-47fc-91d9-105fca414382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:86:27,bridge_name='br-int',has_traffic_filtering=True,id=9635f951-17ba-47fc-91d9-105fca414382,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9635f951-17') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG os_vif [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:86:27,bridge_name='br-int',has_traffic_filtering=True,id=9635f951-17ba-47fc-91d9-105fca414382,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9635f951-17') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f32abd18-442a-5f91-8a1f-1a965eb1550b', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9635f951-17, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9635f951-17, col_values=(('qos', UUID('c0ac4fa9-10e9-409f-bf52-302d763dcec4')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9635f951-17, col_values=(('external_ids', {'iface-id': '9635f951-17ba-47fc-91d9-105fca414382', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:86:27', 'vm-uuid': 'eab83056-14bd-4dd3-bcd0-7bc25cb8f722'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:22 user nova-compute[74540]: INFO os_vif [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:86:27,bridge_name='br-int',has_traffic_filtering=True,id=9635f951-17ba-47fc-91d9-105fca414382,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9635f951-17')
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] No VIF found with MAC fa:16:3e:74:86:27, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.network.neutron [req-0a9241f3-60ce-42d9-bbc8-572685fbafc4 req-5f4702d7-3788-4bce-833c-401563feb45c service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Updated VIF entry in instance network info cache for port 9635f951-17ba-47fc-91d9-105fca414382. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG nova.network.neutron [req-0a9241f3-60ce-42d9-bbc8-572685fbafc4 req-5f4702d7-3788-4bce-833c-401563feb45c service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Updating instance_info_cache with network_info: [{"id": "9635f951-17ba-47fc-91d9-105fca414382", "address": "fa:16:3e:74:86:27", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9635f951-17", "ovs_interfaceid": "9635f951-17ba-47fc-91d9-105fca414382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0a9241f3-60ce-42d9-bbc8-572685fbafc4 req-5f4702d7-3788-4bce-833c-401563feb45c service nova] Releasing lock "refresh_cache-eab83056-14bd-4dd3-bcd0-7bc25cb8f722" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Stashing vm_state: active {{(pid=74540) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 07 04:15:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:23 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:15:23 user nova-compute[74540]: INFO nova.compute.claims [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Claim successful on node user
Nov 07 04:15:23 user nova-compute[74540]: INFO nova.compute.resource_tracker [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updating resource usage from migration cabd3358-493f-45d2-a277-9ce359ec26f9
Nov 07 04:15:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-4e689daf-a9b3-4e5d-bb54-5ef4ea031614 req-4d2962af-8af7-4088-b7de-77c88e1a492e service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received event network-changed-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-4e689daf-a9b3-4e5d-bb54-5ef4ea031614 req-4d2962af-8af7-4088-b7de-77c88e1a492e service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Refreshing instance network info cache due to event network-changed-9a1d45ca-93e6-4b48-a819-06ae409b7c89. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:15:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4e689daf-a9b3-4e5d-bb54-5ef4ea031614 req-4d2962af-8af7-4088-b7de-77c88e1a492e service nova] Acquiring lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4e689daf-a9b3-4e5d-bb54-5ef4ea031614 req-4d2962af-8af7-4088-b7de-77c88e1a492e service nova] Acquired lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-4e689daf-a9b3-4e5d-bb54-5ef4ea031614 req-4d2962af-8af7-4088-b7de-77c88e1a492e service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Refreshing network info cache for port 9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:15:23 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:15:23 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:15:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.496s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:23 user nova-compute[74540]: INFO nova.compute.manager [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Migrating
Nov 07 04:15:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-955f12c8-390e-40ab-a9c3-178caf122c99 req-4d80f9b8-59f5-41d4-ac3a-58e807ae71e2 service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Received event network-vif-plugged-9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-955f12c8-390e-40ab-a9c3-178caf122c99 req-4d80f9b8-59f5-41d4-ac3a-58e807ae71e2 service nova] Acquiring lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-955f12c8-390e-40ab-a9c3-178caf122c99 req-4d80f9b8-59f5-41d4-ac3a-58e807ae71e2 service nova] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-955f12c8-390e-40ab-a9c3-178caf122c99 req-4d80f9b8-59f5-41d4-ac3a-58e807ae71e2 service nova] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-955f12c8-390e-40ab-a9c3-178caf122c99 req-4d80f9b8-59f5-41d4-ac3a-58e807ae71e2 service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] No waiting events found dispatching network-vif-plugged-9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:15:24 user nova-compute[74540]: WARNING nova.compute.manager [req-955f12c8-390e-40ab-a9c3-178caf122c99 req-4d80f9b8-59f5-41d4-ac3a-58e807ae71e2 service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Received unexpected event network-vif-plugged-9635f951-17ba-47fc-91d9-105fca414382 for instance with vm_state building and task_state spawning.
Nov 07 04:15:24 user nova-compute[74540]: DEBUG nova.network.neutron [req-4e689daf-a9b3-4e5d-bb54-5ef4ea031614 req-4d2962af-8af7-4088-b7de-77c88e1a492e service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updated VIF entry in instance network info cache for port 9a1d45ca-93e6-4b48-a819-06ae409b7c89. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG nova.network.neutron [req-4e689daf-a9b3-4e5d-bb54-5ef4ea031614 req-4d2962af-8af7-4088-b7de-77c88e1a492e service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updating instance_info_cache with network_info: [{"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4e689daf-a9b3-4e5d-bb54-5ef4ea031614 req-4d2962af-8af7-4088-b7de-77c88e1a492e service nova] Releasing lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquired lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG nova.network.neutron [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:25 user nova-compute[74540]: DEBUG nova.network.neutron [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updating instance_info_cache with network_info: [{"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Releasing lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Starting migrate_disk_and_power_off {{(pid=74540) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 07 04:15:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-aa58b97b-1695-4fd9-9615-f40544d2624c req-f24cdec5-c118-4dbe-8785-a1b0723b7652 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received event network-vif-unplugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-aa58b97b-1695-4fd9-9615-f40544d2624c req-f24cdec5-c118-4dbe-8785-a1b0723b7652 service nova] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-aa58b97b-1695-4fd9-9615-f40544d2624c req-f24cdec5-c118-4dbe-8785-a1b0723b7652 service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-aa58b97b-1695-4fd9-9615-f40544d2624c req-f24cdec5-c118-4dbe-8785-a1b0723b7652 service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-aa58b97b-1695-4fd9-9615-f40544d2624c req-f24cdec5-c118-4dbe-8785-a1b0723b7652 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] No waiting events found dispatching network-vif-unplugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:15:25 user nova-compute[74540]: WARNING nova.compute.manager [req-aa58b97b-1695-4fd9-9615-f40544d2624c req-f24cdec5-c118-4dbe-8785-a1b0723b7652 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received unexpected event network-vif-unplugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 for instance with vm_state active and task_state resize_migrating.
Nov 07 04:15:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:26 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Instance destroyed successfully.
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-209729649',display_name='tempest-ServerActionsTestOtherA-server-209729649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-209729649',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwNZBrKGScuWsQUPfoY0b3AbxyGKSkLExG0cpMUZnRvSTxBRcsFtIZ1RT1pR1+eCQdUJD5DJCUo9GsJbQ2Fmr9SGNPRCHO5qhdeLD9soxcgYrMJdlf2ABhS3l6lT6tLnQ==',key_name='tempest-keypair-987204751',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:13:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-ovt0rkj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=bbed18c8-efc2-453e-825c-caf6a686c9cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-839286673-network", "vif_mac": "fa:16:3e:5d:2b:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-839286673-network", "vif_mac": "fa:16:3e:5d:2b:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_vif [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a1d45ca-93, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e46848c-dcc6-465b-ac72-2d039c48f9fb) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:26 user nova-compute[74540]: INFO os_vif [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93')
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNIMceKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:15:26 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef47d7ce-f247-4ac0-859e-7cbf3bbf016b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:15:26 user nova-compute[74540]: No targets found.
Nov 07 04:15:26 user nova-compute[74540]: iSNS:
Nov 07 04:15:26 user nova-compute[74540]: No targets found.
Nov 07 04:15:26 user nova-compute[74540]: STATIC:
Nov 07 04:15:26 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1
Nov 07 04:15:26 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:15:26 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:15:26 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:15:26 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:15:26 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:15:26 user nova-compute[74540]: FIRMWARE:
Nov 07 04:15:26 user nova-compute[74540]: No targets found.
Nov 07 04:15:26 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:15:26 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:15:26 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[88143c35-6cd1-44b2-ae33-623415fb595b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85096fe-730a-4dc4-ae67-2a9c629d0a12]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:15:26 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:15:26 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:15:26 user nova-compute[74540]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:15:26 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc685990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1'): ({'sdd'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Removing single pathed devices sdd {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5552492-928e-4c2e-a66b-f88e663db067]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d15a0f-ae02-4df3-aeed-dc7fcd85e6b4]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flushing IO for device /dev/sdd {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-91ab3bde-0fe8-48e7-956c-f5c8053df85b req-e2a073c5-5827-489e-af2f-ea8ebcf1527a service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Received event network-vif-plugged-9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-91ab3bde-0fe8-48e7-956c-f5c8053df85b req-e2a073c5-5827-489e-af2f-ea8ebcf1527a service nova] Acquiring lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-91ab3bde-0fe8-48e7-956c-f5c8053df85b req-e2a073c5-5827-489e-af2f-ea8ebcf1527a service nova] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-91ab3bde-0fe8-48e7-956c-f5c8053df85b req-e2a073c5-5827-489e-af2f-ea8ebcf1527a service nova] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-91ab3bde-0fe8-48e7-956c-f5c8053df85b req-e2a073c5-5827-489e-af2f-ea8ebcf1527a service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] No waiting events found dispatching network-vif-plugged-9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:15:26 user nova-compute[74540]: WARNING nova.compute.manager [req-91ab3bde-0fe8-48e7-956c-f5c8053df85b req-e2a073c5-5827-489e-af2f-ea8ebcf1527a service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Received unexpected event network-vif-plugged-9635f951-17ba-47fc-91d9-105fca414382 for instance with vm_state building and task_state spawning.
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6938e72-7886-42cc-b08f-82eea5d7a73e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[591be2e1-9f4d-44f2-afa1-501defe6dd7b]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4803392d', '/dev/disk/by-id/scsi-1SCST_BIO4803392d-7c9f3f4883475ddf', '/dev/disk/by-id/scsi-23763396633663438') {{(pid=85868) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0430ff3-29ec-4475-b261-85069c21c0a7]: (4, None) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[547aefa0-3d72-4f28-81c4-aeffb8a29657]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.compute.manager [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:26 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Instance spawned successfully.
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be06f6f-08e2-4c9e-83d1-fa030f886645]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260]
Nov 07 04:15:26 user nova-compute[74540]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260] successful.
Nov 07 04:15:26 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d533bd4-6a7b-4dcc-a234-76430111ed86]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== disconnect_volume: return (361ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:15:26 user nova-compute[74540]: INFO nova.compute.manager [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 07 04:15:26 user nova-compute[74540]: DEBUG nova.compute.manager [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:15:26 user nova-compute[74540]: INFO nova.compute.manager [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Took 7.04 seconds to build instance.
Nov 07 04:15:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-12602c4d-5fde-4dfc-9077-8bf18a32a5b4 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.154s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-fc1857ca-3502-464a-b7c9-f7e214c9d2d5 req-30020e43-4cb9-4238-bfd4-bebe4490e9ac service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received event network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fc1857ca-3502-464a-b7c9-f7e214c9d2d5 req-30020e43-4cb9-4238-bfd4-bebe4490e9ac service nova] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fc1857ca-3502-464a-b7c9-f7e214c9d2d5 req-30020e43-4cb9-4238-bfd4-bebe4490e9ac service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fc1857ca-3502-464a-b7c9-f7e214c9d2d5 req-30020e43-4cb9-4238-bfd4-bebe4490e9ac service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-fc1857ca-3502-464a-b7c9-f7e214c9d2d5 req-30020e43-4cb9-4238-bfd4-bebe4490e9ac service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] No waiting events found dispatching network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:15:27 user nova-compute[74540]: WARNING nova.compute.manager [req-fc1857ca-3502-464a-b7c9-f7e214c9d2d5 req-30020e43-4cb9-4238-bfd4-bebe4490e9ac service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received unexpected event network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 for instance with vm_state active and task_state resize_migrating.
Nov 07 04:15:27 user nova-compute[74540]: DEBUG nova.network.neutron [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Port 9a1d45ca-93e6-4b48-a819-06ae409b7c89 binding to destination host user is already ACTIVE {{(pid=74540) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 07 04:15:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquired lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:27 user nova-compute[74540]: DEBUG nova.network.neutron [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG nova.network.neutron [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updating instance_info_cache with network_info: [{"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Releasing lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG os_brick.utils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8367e757-c799-49f1-87e1-f0c75bfaed91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a36edf7-99c4-44fe-b148-3fa1bf05de47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aed1ca0-1e96-45ad-a48b-5b4e1595fbbc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3b54fe-48ff-4c03-9cba-f6812382e6a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:15:28 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:15:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8286b8-95c8-42bc-8c1e-960b28822d8b]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:15:28 user nova-compute[74540]: DEBUG os_brick.utils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:15:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:38 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:15:40 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:15:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:15:43 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:15:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:15:44 user nova-compute[74540]: INFO nova.compute.manager [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] instance snapshotting
Nov 07 04:15:44 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Beginning live snapshot process
Nov 07 04:15:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json -f qcow2 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json -f qcow2 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:15:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:15:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0vgu5lx_/b1704756aec64e1ba6e15d8c1b4fdbcd.delta 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0vgu5lx_/b1704756aec64e1ba6e15d8c1b4fdbcd.delta 1073741824" returned: 0 in 0.054s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:45 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 07 04:15:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:15:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] COPY block job progress, current cursor: 20905984 final cursor: 75563008 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:15:46 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:15:46 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 07 04:15:46 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:15:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0vgu5lx_/b1704756aec64e1ba6e15d8c1b4fdbcd.delta /opt/stack/data/nova/instances/snapshots/tmp0vgu5lx_/b1704756aec64e1ba6e15d8c1b4fdbcd {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:47 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0vgu5lx_/b1704756aec64e1ba6e15d8c1b4fdbcd.delta /opt/stack/data/nova/instances/snapshots/tmp0vgu5lx_/b1704756aec64e1ba6e15d8c1b4fdbcd" returned: 0 in 0.655s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:47 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Snapshot extracted, beginning image upload
Nov 07 04:15:47 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:15:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:15:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:15:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:15:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:15:50 user nova-compute[74540]: INFO nova.compute.claims [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Claim successful on node user
Nov 07 04:15:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Snapshot image upload complete
Nov 07 04:15:51 user nova-compute[74540]: INFO nova.compute.manager [None req-277ce79e-ab9e-4c1b-b5cc-8020f0880c3c tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Took 6.75 seconds to snapshot the instance on the hypervisor.
Nov 07 04:15:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG nova.network.neutron [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:15:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:15:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG nova.policy [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88c598b2585a41829af42b129ccb51fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b682de4430634d9c88abd728196079a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:15:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Creating image(s)
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "/opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "/opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk 1073741824" returned: 0 in 0.080s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Successfully created port: 75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Starting finish_migration {{(pid=74540) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Instance directory exists: not creating {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 04:15:52 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Creating image(s)
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Ensure instance console log exists: /opt/stack/data/nova/instances/bbed18c8-efc2-453e-825c-caf6a686c9cb/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Start _get_guest_xml network_info=[{"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-839286673-network", "vif_mac": "fa:16:3e:5d:2b:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNIMceKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bbed18c8-efc2-453e-825c-caf6a686c9cb', 'attached_at': '2023-11-07T04:15:52.000000', 'detached_at': '', 'volume_id': '4152bc01-2e45-4a4a-898e-67ca9253d5d1', 'serial': '4152bc01-2e45-4a4a-898e-67ca9253d5d1'}, 'boot_index': 0, 'attachment_id': '18750978-e385-470b-bb88-ba70e07a1f96', 'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.561s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:52 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:52 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:15:52 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:52 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7704MB free_disk=24.843704223632812GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNIMceKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:15:52 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:15:52 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:15:52 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[85893146-c83d-44e4-b2a8-fb19694be49e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:15:52 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc158525-ae13-4963-96c3-3d9f11f57392]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1] added
Nov 07 04:15:52 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Cannot resize image /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Ensure instance console log exists: /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Successfully updated port: 75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[145f0fba-473b-43ec-a5ef-71fdb3c6a5bc]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "refresh_cache-7f2a213c-40b8-4a93-a6ae-e363fbc03496" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquired lock "refresh_cache-7f2a213c-40b8-4a93-a6ae-e363fbc03496" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Applying migration context for instance bbed18c8-efc2-453e-825c-caf6a686c9cb as it has an incoming, in-progress migration cabd3358-493f-45d2-a277-9ce359ec26f9. Migration status is post-migrating {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 07 04:15:52 user nova-compute[74540]: INFO nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updating resource usage from migration cabd3358-493f-45d2-a277-9ce359ec26f9
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[734595d8-075b-4f3c-bd93-482ca80ba0a9]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-5074fd88-cf91-4206-82b6-c248d45460e3 req-c99908e9-5fb7-4518-84e9-edd7a73049f1 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Received event network-changed-75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-5074fd88-cf91-4206-82b6-c248d45460e3 req-c99908e9-5fb7-4518-84e9-edd7a73049f1 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Refreshing instance network info cache due to event network-changed-75a1d34f-2b29-46d6-a97c-107793dfb129. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5074fd88-cf91-4206-82b6-c248d45460e3 req-c99908e9-5fb7-4518-84e9-edd7a73049f1 service nova] Acquiring lock "refresh_cache-7f2a213c-40b8-4a93-a6ae-e363fbc03496" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNIMceKd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 93ecf822-fcd9-41cc-97a3-3b92a49571da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 60104cc3-faf7-408c-8b95-7195ad105d3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance eab83056-14bd-4dd3-bcd0-7bc25cb8f722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Migration cabd3358-493f-45d2-a277-9ce359ec26f9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bbed18c8-efc2-453e-825c-caf6a686c9cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 7f2a213c-40b8-4a93-a6ae-e363fbc03496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNIMceKd" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0508b14-eb1c-4342-8073-6440a839a496]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNIMceKd'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e70b630-f263-46f8-9171-d70ab6884ef1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49ae931-50ac-4bad-8678-ef9865c34a0c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:15:52 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:15:52 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:15:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e17792-9a47-4a87-8f07-6d23c5706fd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260]
Nov 07 04:15:53 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260] successful.
Nov 07 04:15:53 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23dfd30-c75d-4eba-967c-b87889987bff]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d61829-825a-424c-927d-60de10bd148d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:15:53 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:15:53 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:15:53 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:15:53 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1aa798c-bb56-45a3-83a0-0d0b83cc6e2f]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNIMceKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.network.neutron [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Updating instance_info_cache with network_info: [{"id": "75a1d34f-2b29-46d6-a97c-107793dfb129", "address": "fa:16:3e:e5:4e:85", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a1d34f-2b", "ovs_interfaceid": "75a1d34f-2b29-46d6-a97c-107793dfb129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Releasing lock "refresh_cache-7f2a213c-40b8-4a93-a6ae-e363fbc03496" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Instance network_info: |[{"id": "75a1d34f-2b29-46d6-a97c-107793dfb129", "address": "fa:16:3e:e5:4e:85", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a1d34f-2b", "ovs_interfaceid": "75a1d34f-2b29-46d6-a97c-107793dfb129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5074fd88-cf91-4206-82b6-c248d45460e3 req-c99908e9-5fb7-4518-84e9-edd7a73049f1 service nova] Acquired lock "refresh_cache-7f2a213c-40b8-4a93-a6ae-e363fbc03496" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.network.neutron [req-5074fd88-cf91-4206-82b6-c248d45460e3 req-c99908e9-5fb7-4518-84e9-edd7a73049f1 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Refreshing network info cache for port 75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Start _get_guest_xml network_info=[{"id": "75a1d34f-2b29-46d6-a97c-107793dfb129", "address": "fa:16:3e:e5:4e:85", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a1d34f-2b", "ovs_interfaceid": "75a1d34f-2b29-46d6-a97c-107793dfb129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:15:53 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:53 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:15:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1344129285',display_name='tempest-VolumesSnapshotTestJSON-instance-1344129285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1344129285',id=35,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbA5zI7pOfP8FOtjPOQTwg140WhEFPNnACKTPYfMvcyxMl4kOF0tUBmaeH2JdCtjD6qr2b79ifk2jz8CQzyA7jRM+kAu03PE+Z+758YfM3r3w1K2PBdRpVpOeQqKuLckg==',key_name='tempest-keypair-737541603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b682de4430634d9c88abd728196079a0',ramdisk_id='',reservation_id='r-p6kyfls4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1818707028',owner_user_name='tempest-VolumesSnapshotTestJSON-1818707028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c598b2585a41829af42b129ccb51fa',uuid=7f2a213c-40b8-4a93-a6ae-e363fbc03496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a1d34f-2b29-46d6-a97c-107793dfb129", "address": "fa:16:3e:e5:4e:85", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a1d34f-2b", "ovs_interfaceid": "75a1d34f-2b29-46d6-a97c-107793dfb129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Converting VIF {"id": "75a1d34f-2b29-46d6-a97c-107793dfb129", "address": "fa:16:3e:e5:4e:85", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a1d34f-2b", "ovs_interfaceid": "75a1d34f-2b29-46d6-a97c-107793dfb129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4e:85,bridge_name='br-int',has_traffic_filtering=True,id=75a1d34f-2b29-46d6-a97c-107793dfb129,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a1d34f-2b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.objects.instance [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f2a213c-40b8-4a93-a6ae-e363fbc03496 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:15:53 user nova-compute[74540]:   <uuid>7f2a213c-40b8-4a93-a6ae-e363fbc03496</uuid>
Nov 07 04:15:53 user nova-compute[74540]:   <name>instance-00000023</name>
Nov 07 04:15:53 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:15:53 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:15:53 user nova-compute[74540]:   <metadata>
Nov 07 04:15:53 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:15:53 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:15:53 user nova-compute[74540]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1344129285</nova:name>
Nov 07 04:15:53 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:15:53</nova:creationTime>
Nov 07 04:15:53 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:15:53 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:15:53 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:15:53 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:15:53 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:15:53 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:15:53 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:15:53 user nova-compute[74540]:       <nova:owner>
Nov 07 04:15:53 user nova-compute[74540]:         <nova:user uuid="88c598b2585a41829af42b129ccb51fa">tempest-VolumesSnapshotTestJSON-1818707028-project-member</nova:user>
Nov 07 04:15:53 user nova-compute[74540]:         <nova:project uuid="b682de4430634d9c88abd728196079a0">tempest-VolumesSnapshotTestJSON-1818707028</nova:project>
Nov 07 04:15:53 user nova-compute[74540]:       </nova:owner>
Nov 07 04:15:53 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:15:53 user nova-compute[74540]:       <nova:ports>
Nov 07 04:15:53 user nova-compute[74540]:         <nova:port uuid="75a1d34f-2b29-46d6-a97c-107793dfb129">
Nov 07 04:15:53 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 04:15:53 user nova-compute[74540]:         </nova:port>
Nov 07 04:15:53 user nova-compute[74540]:       </nova:ports>
Nov 07 04:15:53 user nova-compute[74540]:     </nova:instance>
Nov 07 04:15:53 user nova-compute[74540]:   </metadata>
Nov 07 04:15:53 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:15:53 user nova-compute[74540]:     <system>
Nov 07 04:15:53 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:15:53 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:15:53 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:15:53 user nova-compute[74540]:       <entry name="serial">7f2a213c-40b8-4a93-a6ae-e363fbc03496</entry>
Nov 07 04:15:53 user nova-compute[74540]:       <entry name="uuid">7f2a213c-40b8-4a93-a6ae-e363fbc03496</entry>
Nov 07 04:15:53 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:15:53 user nova-compute[74540]:     </system>
Nov 07 04:15:53 user nova-compute[74540]:   </sysinfo>
Nov 07 04:15:53 user nova-compute[74540]:   <os>
Nov 07 04:15:53 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:15:53 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:15:53 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:15:53 user nova-compute[74540]:   </os>
Nov 07 04:15:53 user nova-compute[74540]:   <features>
Nov 07 04:15:53 user nova-compute[74540]:     <acpi/>
Nov 07 04:15:53 user nova-compute[74540]:     <apic/>
Nov 07 04:15:53 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:15:53 user nova-compute[74540]:   </features>
Nov 07 04:15:53 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:15:53 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:15:53 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:15:53 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:15:53 user nova-compute[74540]:   </clock>
Nov 07 04:15:53 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:15:53 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:15:53 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:15:53 user nova-compute[74540]:   </cpu>
Nov 07 04:15:53 user nova-compute[74540]:   <devices>
Nov 07 04:15:53 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:15:53 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:15:53 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk"/>
Nov 07 04:15:53 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:15:53 user nova-compute[74540]:     </disk>
Nov 07 04:15:53 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:15:53 user nova-compute[74540]:       <mac address="fa:16:3e:e5:4e:85"/>
Nov 07 04:15:53 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:15:53 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:15:53 user nova-compute[74540]:       <target dev="tap75a1d34f-2b"/>
Nov 07 04:15:53 user nova-compute[74540]:     </interface>
Nov 07 04:15:53 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:15:53 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/console.log" append="off"/>
Nov 07 04:15:53 user nova-compute[74540]:     </serial>
Nov 07 04:15:53 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:15:53 user nova-compute[74540]:     <video>
Nov 07 04:15:53 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:15:53 user nova-compute[74540]:     </video>
Nov 07 04:15:53 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:15:53 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:15:53 user nova-compute[74540]:     </rng>
Nov 07 04:15:53 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:15:53 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:15:53 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:15:53 user nova-compute[74540]:     </memballoon>
Nov 07 04:15:53 user nova-compute[74540]:   </devices>
Nov 07 04:15:53 user nova-compute[74540]: </domain>
Nov 07 04:15:53 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:15:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1344129285',display_name='tempest-VolumesSnapshotTestJSON-instance-1344129285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1344129285',id=35,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbA5zI7pOfP8FOtjPOQTwg140WhEFPNnACKTPYfMvcyxMl4kOF0tUBmaeH2JdCtjD6qr2b79ifk2jz8CQzyA7jRM+kAu03PE+Z+758YfM3r3w1K2PBdRpVpOeQqKuLckg==',key_name='tempest-keypair-737541603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b682de4430634d9c88abd728196079a0',ramdisk_id='',reservation_id='r-p6kyfls4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1818707028',owner_user_name='tempest-VolumesSnapshotTestJSON-1818707028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c598b2585a41829af42b129ccb51fa',uuid=7f2a213c-40b8-4a93-a6ae-e363fbc03496,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a1d34f-2b29-46d6-a97c-107793dfb129", "address": "fa:16:3e:e5:4e:85", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a1d34f-2b", "ovs_interfaceid": "75a1d34f-2b29-46d6-a97c-107793dfb129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Converting VIF {"id": "75a1d34f-2b29-46d6-a97c-107793dfb129", "address": "fa:16:3e:e5:4e:85", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a1d34f-2b", "ovs_interfaceid": "75a1d34f-2b29-46d6-a97c-107793dfb129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4e:85,bridge_name='br-int',has_traffic_filtering=True,id=75a1d34f-2b29-46d6-a97c-107793dfb129,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a1d34f-2b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG os_vif [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4e:85,bridge_name='br-int',has_traffic_filtering=True,id=75a1d34f-2b29-46d6-a97c-107793dfb129,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a1d34f-2b') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0309b3ee-b2e2-5fa1-a8f0-878fe3a277e3', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75a1d34f-2b, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75a1d34f-2b, col_values=(('qos', UUID('12fd7c81-927f-4575-b212-3ee3919783a6')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75a1d34f-2b, col_values=(('external_ids', {'iface-id': '75a1d34f-2b29-46d6-a97c-107793dfb129', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:4e:85', 'vm-uuid': '7f2a213c-40b8-4a93-a6ae-e363fbc03496'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:15:53 user nova-compute[74540]: INFO os_vif [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:4e:85,bridge_name='br-int',has_traffic_filtering=True,id=75a1d34f-2b29-46d6-a97c-107793dfb129,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a1d34f-2b')
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.764s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "3f430e2c-d045-48b8-8266-76b8096995f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "3f430e2c-d045-48b8-8266-76b8096995f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] No VIF found with MAC fa:16:3e:e5:4e:85, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:15:53 user nova-compute[74540]: INFO nova.compute.claims [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Claim successful on node user
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.network.neutron [req-5074fd88-cf91-4206-82b6-c248d45460e3 req-c99908e9-5fb7-4518-84e9-edd7a73049f1 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Updated VIF entry in instance network info cache for port 75a1d34f-2b29-46d6-a97c-107793dfb129. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG nova.network.neutron [req-5074fd88-cf91-4206-82b6-c248d45460e3 req-c99908e9-5fb7-4518-84e9-edd7a73049f1 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Updating instance_info_cache with network_info: [{"id": "75a1d34f-2b29-46d6-a97c-107793dfb129", "address": "fa:16:3e:e5:4e:85", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a1d34f-2b", "ovs_interfaceid": "75a1d34f-2b29-46d6-a97c-107793dfb129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5074fd88-cf91-4206-82b6-c248d45460e3 req-c99908e9-5fb7-4518-84e9-edd7a73049f1 service nova] Releasing lock "refresh_cache-7f2a213c-40b8-4a93-a6ae-e363fbc03496" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23763396633663438', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763396633663438', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-209729649',display_name='tempest-ServerActionsTestOtherA-server-209729649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-209729649',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwNZBrKGScuWsQUPfoY0b3AbxyGKSkLExG0cpMUZnRvSTxBRcsFtIZ1RT1pR1+eCQdUJD5DJCUo9GsJbQ2Fmr9SGNPRCHO5qhdeLD9soxcgYrMJdlf2ABhS3l6lT6tLnQ==',key_name='tempest-keypair-987204751',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:13:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-ovt0rkj3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=bbed18c8-efc2-453e-825c-caf6a686c9cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-839286673-network", "vif_mac": "fa:16:3e:5d:2b:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-839286673-network", "vif_mac": "fa:16:3e:5d:2b:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:15:54 user nova-compute[74540]:   <uuid>bbed18c8-efc2-453e-825c-caf6a686c9cb</uuid>
Nov 07 04:15:54 user nova-compute[74540]:   <name>instance-0000001f</name>
Nov 07 04:15:54 user nova-compute[74540]:   <memory>2097152</memory>
Nov 07 04:15:54 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:15:54 user nova-compute[74540]:   <metadata>
Nov 07 04:15:54 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:15:54 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:15:54 user nova-compute[74540]:       <nova:name>tempest-ServerActionsTestOtherA-server-209729649</nova:name>
Nov 07 04:15:54 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:15:52</nova:creationTime>
Nov 07 04:15:54 user nova-compute[74540]:       <nova:flavor name="m1.small">
Nov 07 04:15:54 user nova-compute[74540]:         <nova:memory>2048</nova:memory>
Nov 07 04:15:54 user nova-compute[74540]:         <nova:disk>20</nova:disk>
Nov 07 04:15:54 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:15:54 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:15:54 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:15:54 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:15:54 user nova-compute[74540]:       <nova:owner>
Nov 07 04:15:54 user nova-compute[74540]:         <nova:user uuid="bd0ca1c305c04866b3323a98c6796ded">tempest-ServerActionsTestOtherA-28801548-project-member</nova:user>
Nov 07 04:15:54 user nova-compute[74540]:         <nova:project uuid="04e4bbbf680d48fe8534c9ebe909fd50">tempest-ServerActionsTestOtherA-28801548</nova:project>
Nov 07 04:15:54 user nova-compute[74540]:       </nova:owner>
Nov 07 04:15:54 user nova-compute[74540]:       <nova:ports>
Nov 07 04:15:54 user nova-compute[74540]:         <nova:port uuid="9a1d45ca-93e6-4b48-a819-06ae409b7c89">
Nov 07 04:15:54 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 07 04:15:54 user nova-compute[74540]:         </nova:port>
Nov 07 04:15:54 user nova-compute[74540]:       </nova:ports>
Nov 07 04:15:54 user nova-compute[74540]:     </nova:instance>
Nov 07 04:15:54 user nova-compute[74540]:   </metadata>
Nov 07 04:15:54 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:15:54 user nova-compute[74540]:     <system>
Nov 07 04:15:54 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:15:54 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:15:54 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:15:54 user nova-compute[74540]:       <entry name="serial">bbed18c8-efc2-453e-825c-caf6a686c9cb</entry>
Nov 07 04:15:54 user nova-compute[74540]:       <entry name="uuid">bbed18c8-efc2-453e-825c-caf6a686c9cb</entry>
Nov 07 04:15:54 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:15:54 user nova-compute[74540]:     </system>
Nov 07 04:15:54 user nova-compute[74540]:   </sysinfo>
Nov 07 04:15:54 user nova-compute[74540]:   <os>
Nov 07 04:15:54 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:15:54 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:15:54 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:15:54 user nova-compute[74540]:   </os>
Nov 07 04:15:54 user nova-compute[74540]:   <features>
Nov 07 04:15:54 user nova-compute[74540]:     <acpi/>
Nov 07 04:15:54 user nova-compute[74540]:     <apic/>
Nov 07 04:15:54 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:15:54 user nova-compute[74540]:   </features>
Nov 07 04:15:54 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:15:54 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:15:54 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:15:54 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:15:54 user nova-compute[74540]:   </clock>
Nov 07 04:15:54 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:15:54 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:15:54 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:15:54 user nova-compute[74540]:   </cpu>
Nov 07 04:15:54 user nova-compute[74540]:   <devices>
Nov 07 04:15:54 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:15:54 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:15:54 user nova-compute[74540]:       <source dev="/dev/sdc"/>
Nov 07 04:15:54 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:15:54 user nova-compute[74540]:       <serial>4152bc01-2e45-4a4a-898e-67ca9253d5d1</serial>
Nov 07 04:15:54 user nova-compute[74540]:     </disk>
Nov 07 04:15:54 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:15:54 user nova-compute[74540]:       <mac address="fa:16:3e:5d:2b:e9"/>
Nov 07 04:15:54 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:15:54 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:15:54 user nova-compute[74540]:       <target dev="tap9a1d45ca-93"/>
Nov 07 04:15:54 user nova-compute[74540]:     </interface>
Nov 07 04:15:54 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:15:54 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/bbed18c8-efc2-453e-825c-caf6a686c9cb/console.log" append="off"/>
Nov 07 04:15:54 user nova-compute[74540]:     </serial>
Nov 07 04:15:54 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:15:54 user nova-compute[74540]:     <video>
Nov 07 04:15:54 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:15:54 user nova-compute[74540]:     </video>
Nov 07 04:15:54 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:15:54 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:15:54 user nova-compute[74540]:     </rng>
Nov 07 04:15:54 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:15:54 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:15:54 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:15:54 user nova-compute[74540]:     </memballoon>
Nov 07 04:15:54 user nova-compute[74540]:   </devices>
Nov 07 04:15:54 user nova-compute[74540]: </domain>
Nov 07 04:15:54 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-209729649',display_name='tempest-ServerActionsTestOtherA-server-209729649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-209729649',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwNZBrKGScuWsQUPfoY0b3AbxyGKSkLExG0cpMUZnRvSTxBRcsFtIZ1RT1pR1+eCQdUJD5DJCUo9GsJbQ2Fmr9SGNPRCHO5qhdeLD9soxcgYrMJdlf2ABhS3l6lT6tLnQ==',key_name='tempest-keypair-987204751',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:13:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-ovt0rkj3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=bbed18c8-efc2-453e-825c-caf6a686c9cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-839286673-network", "vif_mac": "fa:16:3e:5d:2b:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-839286673-network", "vif_mac": "fa:16:3e:5d:2b:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG os_vif [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fcac2f3-a30d-5436-b35b-570382c05f37', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a1d45ca-93, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a1d45ca-93, col_values=(('qos', UUID('5c573d26-586e-4858-9d46-2b5d4dc26de2')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a1d45ca-93, col_values=(('external_ids', {'iface-id': '9a1d45ca-93e6-4b48-a819-06ae409b7c89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:2b:e9', 'vm-uuid': 'bbed18c8-efc2-453e-825c-caf6a686c9cb'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:54 user nova-compute[74540]: INFO os_vif [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93')
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:15:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] No VIF found with MAC fa:16:3e:5d:2b:e9, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.policy [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3580d0b365fa4f2f8599747d474e8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f9a52c6a1044b8bc854c8a86d81827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:15:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Creating image(s)
Nov 07 04:15:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "/opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "/opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "cb6b3f685290481b51d08c4fe3fd634dceba6ed0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cb6b3f685290481b51d08c4fe3fd634dceba6ed0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0.part --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Successfully created port: 3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0.part --force-share --output=json" returned: 0 in 0.264s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG nova.virt.images [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] aa764985-a13a-4f29-b6e0-0615762ac871 was qcow2, converting to raw {{(pid=74540) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0.part /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0.converted {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-c57ff370-7310-44dc-9bbc-1d186354312b req-6b742c3a-5f2f-430f-b5d8-f8505b55ce5f service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Received event network-vif-plugged-75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c57ff370-7310-44dc-9bbc-1d186354312b req-6b742c3a-5f2f-430f-b5d8-f8505b55ce5f service nova] Acquiring lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c57ff370-7310-44dc-9bbc-1d186354312b req-6b742c3a-5f2f-430f-b5d8-f8505b55ce5f service nova] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c57ff370-7310-44dc-9bbc-1d186354312b req-6b742c3a-5f2f-430f-b5d8-f8505b55ce5f service nova] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-c57ff370-7310-44dc-9bbc-1d186354312b req-6b742c3a-5f2f-430f-b5d8-f8505b55ce5f service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] No waiting events found dispatching network-vif-plugged-75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:15:56 user nova-compute[74540]: WARNING nova.compute.manager [req-c57ff370-7310-44dc-9bbc-1d186354312b req-6b742c3a-5f2f-430f-b5d8-f8505b55ce5f service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Received unexpected event network-vif-plugged-75a1d34f-2b29-46d6-a97c-107793dfb129 for instance with vm_state building and task_state spawning.
Nov 07 04:15:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0.part /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0.converted" returned: 0 in 0.558s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0.converted --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cb6b3f685290481b51d08c4fe3fd634dceba6ed0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.647s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Successfully updated port: 3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "refresh_cache-3f430e2c-d045-48b8-8266-76b8096995f0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquired lock "refresh_cache-3f430e2c-d045-48b8-8266-76b8096995f0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-15a29b02-a59e-48b4-afa9-4f4a47b4bbe2 req-dda911b2-a5cc-4d6d-94c6-436f3e9383c3 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received event network-changed-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-15a29b02-a59e-48b4-afa9-4f4a47b4bbe2 req-dda911b2-a5cc-4d6d-94c6-436f3e9383c3 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Refreshing instance network info cache due to event network-changed-3d22bce5-b4e4-433c-a8bf-e25013902730. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-15a29b02-a59e-48b4-afa9-4f4a47b4bbe2 req-dda911b2-a5cc-4d6d-94c6-436f3e9383c3 service nova] Acquiring lock "refresh_cache-3f430e2c-d045-48b8-8266-76b8096995f0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0 --force-share --output=json" returned: 0 in 0.233s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "cb6b3f685290481b51d08c4fe3fd634dceba6ed0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cb6b3f685290481b51d08c4fe3fd634dceba6ed0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0 --force-share --output=json" returned: 0 in 0.201s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0,backing_fmt=raw /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0,backing_fmt=raw /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk 1073741824" returned: 0 in 0.054s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cb6b3f685290481b51d08c4fe3fd634dceba6ed0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0 --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Ensure instance console log exists: /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Updating instance_info_cache with network_info: [{"id": "3d22bce5-b4e4-433c-a8bf-e25013902730", "address": "fa:16:3e:7d:d5:46", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d22bce5-b4", "ovs_interfaceid": "3d22bce5-b4e4-433c-a8bf-e25013902730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Releasing lock "refresh_cache-3f430e2c-d045-48b8-8266-76b8096995f0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Instance network_info: |[{"id": "3d22bce5-b4e4-433c-a8bf-e25013902730", "address": "fa:16:3e:7d:d5:46", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d22bce5-b4", "ovs_interfaceid": "3d22bce5-b4e4-433c-a8bf-e25013902730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-15a29b02-a59e-48b4-afa9-4f4a47b4bbe2 req-dda911b2-a5cc-4d6d-94c6-436f3e9383c3 service nova] Acquired lock "refresh_cache-3f430e2c-d045-48b8-8266-76b8096995f0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.network.neutron [req-15a29b02-a59e-48b4-afa9-4f4a47b4bbe2 req-dda911b2-a5cc-4d6d-94c6-436f3e9383c3 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Refreshing network info cache for port 3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Start _get_guest_xml network_info=[{"id": "3d22bce5-b4e4-433c-a8bf-e25013902730", "address": "fa:16:3e:7d:d5:46", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d22bce5-b4", "ovs_interfaceid": "3d22bce5-b4e4-433c-a8bf-e25013902730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9de1302782624e6baa808312919cd948',container_format='bare',created_at=2023-11-07T04:15:44Z,direct_url=<?>,disk_format='qcow2',id=aa764985-a13a-4f29-b6e0-0615762ac871,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1332363760',owner='29f9a52c6a1044b8bc854c8a86d81827',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-07T04:15:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'aa764985-a13a-4f29-b6e0-0615762ac871'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:15:57 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:57 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9de1302782624e6baa808312919cd948',container_format='bare',created_at=2023-11-07T04:15:44Z,direct_url=<?>,disk_format='qcow2',id=aa764985-a13a-4f29-b6e0-0615762ac871,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1332363760',owner='29f9a52c6a1044b8bc854c8a86d81827',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-07T04:15:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2025278445',display_name='tempest-TestStampPattern-server-2025278445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2025278445',id=36,image_ref='aa764985-a13a-4f29-b6e0-0615762ac871',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoMfE2Q8gNUKNl0nmrHkjFV2OAeuMJzS+ql/IUfGPF1eNzZ6Aqxy5NrG9xZoAUwwIFWT3HNiNLxHgs0GzsPBY0ju025YOE6ZmiTIQk/+eBuGfERE2Lyjk3Ye8OTrYx9mA==',key_name='tempest-TestStampPattern-1539418775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29f9a52c6a1044b8bc854c8a86d81827',ramdisk_id='',reservation_id='r-axtxacr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='cc15c8fc-e47f-4df0-94ec-8daeacb112c9',image_min_disk='1',image_min_ram='0',image_owner_id='29f9a52c6a1044b8bc854c8a86d81827',image_owner_project_name='tempest-TestStampPattern-310684050',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-310684050-project-member',image_user_id='3580d0b365fa4f2f8599747d474e8c7e',network_allocated='True',owner_project_name='tempest-TestStampPattern-310684050',owner_user_name='tempest-TestStampPattern-310684050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:54Z,user_data=None,user_id='3580d0b365fa4f2f8599747d474e8c7e',uuid=3f430e2c-d045-48b8-8266-76b8096995f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d22bce5-b4e4-433c-a8bf-e25013902730", "address": "fa:16:3e:7d:d5:46", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d22bce5-b4", "ovs_interfaceid": "3d22bce5-b4e4-433c-a8bf-e25013902730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Converting VIF {"id": "3d22bce5-b4e4-433c-a8bf-e25013902730", "address": "fa:16:3e:7d:d5:46", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d22bce5-b4", "ovs_interfaceid": "3d22bce5-b4e4-433c-a8bf-e25013902730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d5:46,bridge_name='br-int',has_traffic_filtering=True,id=3d22bce5-b4e4-433c-a8bf-e25013902730,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d22bce5-b4') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.objects.instance [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f430e2c-d045-48b8-8266-76b8096995f0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:15:57 user nova-compute[74540]:   <uuid>3f430e2c-d045-48b8-8266-76b8096995f0</uuid>
Nov 07 04:15:57 user nova-compute[74540]:   <name>instance-00000024</name>
Nov 07 04:15:57 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:15:57 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:15:57 user nova-compute[74540]:   <metadata>
Nov 07 04:15:57 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:15:57 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:15:57 user nova-compute[74540]:       <nova:name>tempest-TestStampPattern-server-2025278445</nova:name>
Nov 07 04:15:57 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:15:57</nova:creationTime>
Nov 07 04:15:57 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:15:57 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:15:57 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:15:57 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:15:57 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:15:57 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:15:57 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:15:57 user nova-compute[74540]:       <nova:owner>
Nov 07 04:15:57 user nova-compute[74540]:         <nova:user uuid="3580d0b365fa4f2f8599747d474e8c7e">tempest-TestStampPattern-310684050-project-member</nova:user>
Nov 07 04:15:57 user nova-compute[74540]:         <nova:project uuid="29f9a52c6a1044b8bc854c8a86d81827">tempest-TestStampPattern-310684050</nova:project>
Nov 07 04:15:57 user nova-compute[74540]:       </nova:owner>
Nov 07 04:15:57 user nova-compute[74540]:       <nova:root type="image" uuid="aa764985-a13a-4f29-b6e0-0615762ac871"/>
Nov 07 04:15:57 user nova-compute[74540]:       <nova:ports>
Nov 07 04:15:57 user nova-compute[74540]:         <nova:port uuid="3d22bce5-b4e4-433c-a8bf-e25013902730">
Nov 07 04:15:57 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 04:15:57 user nova-compute[74540]:         </nova:port>
Nov 07 04:15:57 user nova-compute[74540]:       </nova:ports>
Nov 07 04:15:57 user nova-compute[74540]:     </nova:instance>
Nov 07 04:15:57 user nova-compute[74540]:   </metadata>
Nov 07 04:15:57 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:15:57 user nova-compute[74540]:     <system>
Nov 07 04:15:57 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:15:57 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:15:57 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:15:57 user nova-compute[74540]:       <entry name="serial">3f430e2c-d045-48b8-8266-76b8096995f0</entry>
Nov 07 04:15:57 user nova-compute[74540]:       <entry name="uuid">3f430e2c-d045-48b8-8266-76b8096995f0</entry>
Nov 07 04:15:57 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:15:57 user nova-compute[74540]:     </system>
Nov 07 04:15:57 user nova-compute[74540]:   </sysinfo>
Nov 07 04:15:57 user nova-compute[74540]:   <os>
Nov 07 04:15:57 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:15:57 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:15:57 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:15:57 user nova-compute[74540]:   </os>
Nov 07 04:15:57 user nova-compute[74540]:   <features>
Nov 07 04:15:57 user nova-compute[74540]:     <acpi/>
Nov 07 04:15:57 user nova-compute[74540]:     <apic/>
Nov 07 04:15:57 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:15:57 user nova-compute[74540]:   </features>
Nov 07 04:15:57 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:15:57 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:15:57 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:15:57 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:15:57 user nova-compute[74540]:   </clock>
Nov 07 04:15:57 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:15:57 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:15:57 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:15:57 user nova-compute[74540]:   </cpu>
Nov 07 04:15:57 user nova-compute[74540]:   <devices>
Nov 07 04:15:57 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:15:57 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:15:57 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk"/>
Nov 07 04:15:57 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:15:57 user nova-compute[74540]:     </disk>
Nov 07 04:15:57 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:15:57 user nova-compute[74540]:       <mac address="fa:16:3e:7d:d5:46"/>
Nov 07 04:15:57 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:15:57 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:15:57 user nova-compute[74540]:       <target dev="tap3d22bce5-b4"/>
Nov 07 04:15:57 user nova-compute[74540]:     </interface>
Nov 07 04:15:57 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:15:57 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/console.log" append="off"/>
Nov 07 04:15:57 user nova-compute[74540]:     </serial>
Nov 07 04:15:57 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:15:57 user nova-compute[74540]:     <video>
Nov 07 04:15:57 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:15:57 user nova-compute[74540]:     </video>
Nov 07 04:15:57 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:15:57 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:15:57 user nova-compute[74540]:     </rng>
Nov 07 04:15:57 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:15:57 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:15:57 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:15:57 user nova-compute[74540]:     </memballoon>
Nov 07 04:15:57 user nova-compute[74540]:   </devices>
Nov 07 04:15:57 user nova-compute[74540]: </domain>
Nov 07 04:15:57 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2025278445',display_name='tempest-TestStampPattern-server-2025278445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2025278445',id=36,image_ref='aa764985-a13a-4f29-b6e0-0615762ac871',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoMfE2Q8gNUKNl0nmrHkjFV2OAeuMJzS+ql/IUfGPF1eNzZ6Aqxy5NrG9xZoAUwwIFWT3HNiNLxHgs0GzsPBY0ju025YOE6ZmiTIQk/+eBuGfERE2Lyjk3Ye8OTrYx9mA==',key_name='tempest-TestStampPattern-1539418775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29f9a52c6a1044b8bc854c8a86d81827',ramdisk_id='',reservation_id='r-axtxacr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='cc15c8fc-e47f-4df0-94ec-8daeacb112c9',image_min_disk='1',image_min_ram='0',image_owner_id='29f9a52c6a1044b8bc854c8a86d81827',image_owner_project_name='tempest-TestStampPattern-310684050',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-310684050-project-member',image_user_id='3580d0b365fa4f2f8599747d474e8c7e',network_allocated='True',owner_project_name='tempest-TestStampPattern-310684050',owner_user_name='tempest-TestStampPattern-310684050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:15:54Z,user_data=None,user_id='3580d0b365fa4f2f8599747d474e8c7e',uuid=3f430e2c-d045-48b8-8266-76b8096995f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d22bce5-b4e4-433c-a8bf-e25013902730", "address": "fa:16:3e:7d:d5:46", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d22bce5-b4", "ovs_interfaceid": "3d22bce5-b4e4-433c-a8bf-e25013902730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Converting VIF {"id": "3d22bce5-b4e4-433c-a8bf-e25013902730", "address": "fa:16:3e:7d:d5:46", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d22bce5-b4", "ovs_interfaceid": "3d22bce5-b4e4-433c-a8bf-e25013902730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d5:46,bridge_name='br-int',has_traffic_filtering=True,id=3d22bce5-b4e4-433c-a8bf-e25013902730,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d22bce5-b4') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG os_vif [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d5:46,bridge_name='br-int',has_traffic_filtering=True,id=3d22bce5-b4e4-433c-a8bf-e25013902730,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d22bce5-b4') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15a826ea-797e-58b8-a05e-7799e5114271', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d22bce5-b4, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d22bce5-b4, col_values=(('qos', UUID('075de772-3cc9-4cbd-83d8-28e1b30c521c')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d22bce5-b4, col_values=(('external_ids', {'iface-id': '3d22bce5-b4e4-433c-a8bf-e25013902730', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:d5:46', 'vm-uuid': '3f430e2c-d045-48b8-8266-76b8096995f0'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:57 user nova-compute[74540]: INFO os_vif [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d5:46,bridge_name='br-int',has_traffic_filtering=True,id=3d22bce5-b4e4-433c-a8bf-e25013902730,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d22bce5-b4')
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:15:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] No VIF found with MAC fa:16:3e:7d:d5:46, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:15:58 user nova-compute[74540]: DEBUG nova.network.neutron [req-15a29b02-a59e-48b4-afa9-4f4a47b4bbe2 req-dda911b2-a5cc-4d6d-94c6-436f3e9383c3 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Updated VIF entry in instance network info cache for port 3d22bce5-b4e4-433c-a8bf-e25013902730. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:15:58 user nova-compute[74540]: DEBUG nova.network.neutron [req-15a29b02-a59e-48b4-afa9-4f4a47b4bbe2 req-dda911b2-a5cc-4d6d-94c6-436f3e9383c3 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Updating instance_info_cache with network_info: [{"id": "3d22bce5-b4e4-433c-a8bf-e25013902730", "address": "fa:16:3e:7d:d5:46", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d22bce5-b4", "ovs_interfaceid": "3d22bce5-b4e4-433c-a8bf-e25013902730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:15:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-15a29b02-a59e-48b4-afa9-4f4a47b4bbe2 req-dda911b2-a5cc-4d6d-94c6-436f3e9383c3 service nova] Releasing lock "refresh_cache-3f430e2c-d045-48b8-8266-76b8096995f0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:15:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-78c70e56-1c49-4016-8017-34d771e235d0 req-28285804-0a96-41fc-abf6-ba3cd6e05827 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Received event network-vif-plugged-75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-78c70e56-1c49-4016-8017-34d771e235d0 req-28285804-0a96-41fc-abf6-ba3cd6e05827 service nova] Acquiring lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-78c70e56-1c49-4016-8017-34d771e235d0 req-28285804-0a96-41fc-abf6-ba3cd6e05827 service nova] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-78c70e56-1c49-4016-8017-34d771e235d0 req-28285804-0a96-41fc-abf6-ba3cd6e05827 service nova] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-78c70e56-1c49-4016-8017-34d771e235d0 req-28285804-0a96-41fc-abf6-ba3cd6e05827 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] No waiting events found dispatching network-vif-plugged-75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:15:58 user nova-compute[74540]: WARNING nova.compute.manager [req-78c70e56-1c49-4016-8017-34d771e235d0 req-28285804-0a96-41fc-abf6-ba3cd6e05827 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Received unexpected event network-vif-plugged-75a1d34f-2b29-46d6-a97c-107793dfb129 for instance with vm_state building and task_state spawning.
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-df32b1e8-5d94-47b2-bc07-f9bd8745de46 req-60cda518-941a-40ad-af21-21fc1a9f8243 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received event network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-df32b1e8-5d94-47b2-bc07-f9bd8745de46 req-60cda518-941a-40ad-af21-21fc1a9f8243 service nova] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-df32b1e8-5d94-47b2-bc07-f9bd8745de46 req-60cda518-941a-40ad-af21-21fc1a9f8243 service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-df32b1e8-5d94-47b2-bc07-f9bd8745de46 req-60cda518-941a-40ad-af21-21fc1a9f8243 service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-df32b1e8-5d94-47b2-bc07-f9bd8745de46 req-60cda518-941a-40ad-af21-21fc1a9f8243 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] No waiting events found dispatching network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:15:59 user nova-compute[74540]: WARNING nova.compute.manager [req-df32b1e8-5d94-47b2-bc07-f9bd8745de46 req-60cda518-941a-40ad-af21-21fc1a9f8243 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received unexpected event network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 for instance with vm_state active and task_state resize_finish.
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-df32b1e8-5d94-47b2-bc07-f9bd8745de46 req-60cda518-941a-40ad-af21-21fc1a9f8243 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received event network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-df32b1e8-5d94-47b2-bc07-f9bd8745de46 req-60cda518-941a-40ad-af21-21fc1a9f8243 service nova] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-df32b1e8-5d94-47b2-bc07-f9bd8745de46 req-60cda518-941a-40ad-af21-21fc1a9f8243 service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-df32b1e8-5d94-47b2-bc07-f9bd8745de46 req-60cda518-941a-40ad-af21-21fc1a9f8243 service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.compute.manager [req-df32b1e8-5d94-47b2-bc07-f9bd8745de46 req-60cda518-941a-40ad-af21-21fc1a9f8243 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] No waiting events found dispatching network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:15:59 user nova-compute[74540]: WARNING nova.compute.manager [req-df32b1e8-5d94-47b2-bc07-f9bd8745de46 req-60cda518-941a-40ad-af21-21fc1a9f8243 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received unexpected event network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 for instance with vm_state active and task_state resize_finish.
Nov 07 04:15:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.compute.manager [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:15:59 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Instance spawned successfully.
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.compute.manager [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:15:59 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Instance running successfully.
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Failed to set time: agent not configured {{(pid=74540) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-525ed45c-333c-47b9-a433-18560bf103ef tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] finish_migration finished successfully. {{(pid=74540) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 07 04:15:59 user nova-compute[74540]: INFO nova.compute.manager [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Took 8.19 seconds to spawn the instance on the hypervisor.
Nov 07 04:15:59 user nova-compute[74540]: DEBUG nova.compute.manager [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:15:59 user nova-compute[74540]: INFO nova.compute.manager [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Took 9.24 seconds to build instance.
Nov 07 04:15:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-289a1f8c-1d81-4614-ac5a-6936583c5391 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.421s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG nova.compute.manager [req-279a30e4-0dd6-4c73-82eb-e50f416c1804 req-3230eb1b-81be-4c7b-bfee-7469bc2aa0c7 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received event network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-279a30e4-0dd6-4c73-82eb-e50f416c1804 req-3230eb1b-81be-4c7b-bfee-7469bc2aa0c7 service nova] Acquiring lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-279a30e4-0dd6-4c73-82eb-e50f416c1804 req-3230eb1b-81be-4c7b-bfee-7469bc2aa0c7 service nova] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-279a30e4-0dd6-4c73-82eb-e50f416c1804 req-3230eb1b-81be-4c7b-bfee-7469bc2aa0c7 service nova] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG nova.compute.manager [req-279a30e4-0dd6-4c73-82eb-e50f416c1804 req-3230eb1b-81be-4c7b-bfee-7469bc2aa0c7 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] No waiting events found dispatching network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:16:01 user nova-compute[74540]: WARNING nova.compute.manager [req-279a30e4-0dd6-4c73-82eb-e50f416c1804 req-3230eb1b-81be-4c7b-bfee-7469bc2aa0c7 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received unexpected event network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 for instance with vm_state building and task_state spawning.
Nov 07 04:16:01 user nova-compute[74540]: DEBUG nova.compute.manager [req-279a30e4-0dd6-4c73-82eb-e50f416c1804 req-3230eb1b-81be-4c7b-bfee-7469bc2aa0c7 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received event network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-279a30e4-0dd6-4c73-82eb-e50f416c1804 req-3230eb1b-81be-4c7b-bfee-7469bc2aa0c7 service nova] Acquiring lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-279a30e4-0dd6-4c73-82eb-e50f416c1804 req-3230eb1b-81be-4c7b-bfee-7469bc2aa0c7 service nova] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-279a30e4-0dd6-4c73-82eb-e50f416c1804 req-3230eb1b-81be-4c7b-bfee-7469bc2aa0c7 service nova] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG nova.compute.manager [req-279a30e4-0dd6-4c73-82eb-e50f416c1804 req-3230eb1b-81be-4c7b-bfee-7469bc2aa0c7 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] No waiting events found dispatching network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:16:01 user nova-compute[74540]: WARNING nova.compute.manager [req-279a30e4-0dd6-4c73-82eb-e50f416c1804 req-3230eb1b-81be-4c7b-bfee-7469bc2aa0c7 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received unexpected event network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 for instance with vm_state building and task_state spawning.
Nov 07 04:16:01 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:16:01 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Instance spawned successfully.
Nov 07 04:16:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:16:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:16:01 user nova-compute[74540]: INFO nova.compute.manager [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Took 7.50 seconds to spawn the instance on the hypervisor.
Nov 07 04:16:01 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:16:02 user nova-compute[74540]: INFO nova.compute.manager [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Took 8.44 seconds to build instance.
Nov 07 04:16:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8d3c64c6-b3c9-4e60-9138-b32d36e5bcba tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "3f430e2c-d045-48b8-8266-76b8096995f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.583s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:16:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:16:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:16:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:16:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:16:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:16:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:16:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:16:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:16:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:16:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:16:30 user nova-compute[74540]: INFO nova.compute.claims [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Claim successful on node user
Nov 07 04:16:30 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG nova.network.neutron [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:16:30 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:16:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG nova.policy [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99ba0f9acca84cdb8cf90c4b313e1b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438cd05cbdb34608940422562ba150c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:16:30 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Creating image(s)
Nov 07 04:16:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "/opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "/opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "/opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.342s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG nova.network.neutron [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Successfully created port: 74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk 1073741824" returned: 0 in 0.051s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.168s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Cannot resize image /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Ensure instance console log exists: /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG nova.network.neutron [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Successfully updated port: 74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "refresh_cache-47f331c2-4e12-45cc-8b9d-a566a0dbbca1" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquired lock "refresh_cache-47f331c2-4e12-45cc-8b9d-a566a0dbbca1" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG nova.network.neutron [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-1e3cb2ef-7357-4454-877e-30088821bf34 req-c42a9e41-735a-4785-9737-c1a8895d324c service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Received event network-changed-74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-1e3cb2ef-7357-4454-877e-30088821bf34 req-c42a9e41-735a-4785-9737-c1a8895d324c service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Refreshing instance network info cache due to event network-changed-74b9d20a-b195-4f89-8cae-b198549a6e7b. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:16:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1e3cb2ef-7357-4454-877e-30088821bf34 req-c42a9e41-735a-4785-9737-c1a8895d324c service nova] Acquiring lock "refresh_cache-47f331c2-4e12-45cc-8b9d-a566a0dbbca1" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Updating instance_info_cache with network_info: [{"id": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "address": "fa:16:3e:95:b2:60", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b9d20a-b1", "ovs_interfaceid": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Releasing lock "refresh_cache-47f331c2-4e12-45cc-8b9d-a566a0dbbca1" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Instance network_info: |[{"id": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "address": "fa:16:3e:95:b2:60", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b9d20a-b1", "ovs_interfaceid": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1e3cb2ef-7357-4454-877e-30088821bf34 req-c42a9e41-735a-4785-9737-c1a8895d324c service nova] Acquired lock "refresh_cache-47f331c2-4e12-45cc-8b9d-a566a0dbbca1" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.network.neutron [req-1e3cb2ef-7357-4454-877e-30088821bf34 req-c42a9e41-735a-4785-9737-c1a8895d324c service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Refreshing network info cache for port 74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Start _get_guest_xml network_info=[{"id": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "address": "fa:16:3e:95:b2:60", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b9d20a-b1", "ovs_interfaceid": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:16:32 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:16:32 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:16:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1735648456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1735648456',id=37,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-f0ieucg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:16:31Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=47f331c2-4e12-45cc-8b9d-a566a0dbbca1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "address": "fa:16:3e:95:b2:60", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b9d20a-b1", "ovs_interfaceid": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "address": "fa:16:3e:95:b2:60", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b9d20a-b1", "ovs_interfaceid": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:b2:60,bridge_name='br-int',has_traffic_filtering=True,id=74b9d20a-b195-4f89-8cae-b198549a6e7b,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b9d20a-b1') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.objects.instance [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'pci_devices' on Instance uuid 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:16:32 user nova-compute[74540]:   <uuid>47f331c2-4e12-45cc-8b9d-a566a0dbbca1</uuid>
Nov 07 04:16:32 user nova-compute[74540]:   <name>instance-00000025</name>
Nov 07 04:16:32 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:16:32 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:16:32 user nova-compute[74540]:   <metadata>
Nov 07 04:16:32 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:16:32 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:16:32 user nova-compute[74540]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1735648456</nova:name>
Nov 07 04:16:32 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:16:32</nova:creationTime>
Nov 07 04:16:32 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:16:32 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:16:32 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:16:32 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:16:32 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:16:32 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:16:32 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:16:32 user nova-compute[74540]:       <nova:owner>
Nov 07 04:16:32 user nova-compute[74540]:         <nova:user uuid="99ba0f9acca84cdb8cf90c4b313e1b7c">tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member</nova:user>
Nov 07 04:16:32 user nova-compute[74540]:         <nova:project uuid="438cd05cbdb34608940422562ba150c8">tempest-ServerBootFromVolumeStableRescueTest-1329597446</nova:project>
Nov 07 04:16:32 user nova-compute[74540]:       </nova:owner>
Nov 07 04:16:32 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:16:32 user nova-compute[74540]:       <nova:ports>
Nov 07 04:16:32 user nova-compute[74540]:         <nova:port uuid="74b9d20a-b195-4f89-8cae-b198549a6e7b">
Nov 07 04:16:32 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:16:32 user nova-compute[74540]:         </nova:port>
Nov 07 04:16:32 user nova-compute[74540]:       </nova:ports>
Nov 07 04:16:32 user nova-compute[74540]:     </nova:instance>
Nov 07 04:16:32 user nova-compute[74540]:   </metadata>
Nov 07 04:16:32 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:16:32 user nova-compute[74540]:     <system>
Nov 07 04:16:32 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:16:32 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:16:32 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:16:32 user nova-compute[74540]:       <entry name="serial">47f331c2-4e12-45cc-8b9d-a566a0dbbca1</entry>
Nov 07 04:16:32 user nova-compute[74540]:       <entry name="uuid">47f331c2-4e12-45cc-8b9d-a566a0dbbca1</entry>
Nov 07 04:16:32 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:16:32 user nova-compute[74540]:     </system>
Nov 07 04:16:32 user nova-compute[74540]:   </sysinfo>
Nov 07 04:16:32 user nova-compute[74540]:   <os>
Nov 07 04:16:32 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:16:32 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:16:32 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:16:32 user nova-compute[74540]:   </os>
Nov 07 04:16:32 user nova-compute[74540]:   <features>
Nov 07 04:16:32 user nova-compute[74540]:     <acpi/>
Nov 07 04:16:32 user nova-compute[74540]:     <apic/>
Nov 07 04:16:32 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:16:32 user nova-compute[74540]:   </features>
Nov 07 04:16:32 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:16:32 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:16:32 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:16:32 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:16:32 user nova-compute[74540]:   </clock>
Nov 07 04:16:32 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:16:32 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:16:32 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:16:32 user nova-compute[74540]:   </cpu>
Nov 07 04:16:32 user nova-compute[74540]:   <devices>
Nov 07 04:16:32 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:16:32 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:16:32 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk"/>
Nov 07 04:16:32 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:16:32 user nova-compute[74540]:     </disk>
Nov 07 04:16:32 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:16:32 user nova-compute[74540]:       <mac address="fa:16:3e:95:b2:60"/>
Nov 07 04:16:32 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:16:32 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:16:32 user nova-compute[74540]:       <target dev="tap74b9d20a-b1"/>
Nov 07 04:16:32 user nova-compute[74540]:     </interface>
Nov 07 04:16:32 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:16:32 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/console.log" append="off"/>
Nov 07 04:16:32 user nova-compute[74540]:     </serial>
Nov 07 04:16:32 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:16:32 user nova-compute[74540]:     <video>
Nov 07 04:16:32 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:16:32 user nova-compute[74540]:     </video>
Nov 07 04:16:32 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:16:32 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:16:32 user nova-compute[74540]:     </rng>
Nov 07 04:16:32 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:16:32 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:16:32 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:16:32 user nova-compute[74540]:     </memballoon>
Nov 07 04:16:32 user nova-compute[74540]:   </devices>
Nov 07 04:16:32 user nova-compute[74540]: </domain>
Nov 07 04:16:32 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:16:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1735648456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1735648456',id=37,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-f0ieucg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:16:31Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=47f331c2-4e12-45cc-8b9d-a566a0dbbca1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "address": "fa:16:3e:95:b2:60", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b9d20a-b1", "ovs_interfaceid": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "address": "fa:16:3e:95:b2:60", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b9d20a-b1", "ovs_interfaceid": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:b2:60,bridge_name='br-int',has_traffic_filtering=True,id=74b9d20a-b195-4f89-8cae-b198549a6e7b,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b9d20a-b1') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG os_vif [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:b2:60,bridge_name='br-int',has_traffic_filtering=True,id=74b9d20a-b195-4f89-8cae-b198549a6e7b,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b9d20a-b1') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb44df96-c63e-51cc-998f-eccce5b46f94', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74b9d20a-b1, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74b9d20a-b1, col_values=(('qos', UUID('598df69f-3cfb-4af7-a170-244851d7f262')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74b9d20a-b1, col_values=(('external_ids', {'iface-id': '74b9d20a-b195-4f89-8cae-b198549a6e7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:b2:60', 'vm-uuid': '47f331c2-4e12-45cc-8b9d-a566a0dbbca1'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:32 user nova-compute[74540]: INFO os_vif [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:b2:60,bridge_name='br-int',has_traffic_filtering=True,id=74b9d20a-b195-4f89-8cae-b198549a6e7b,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b9d20a-b1')
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No VIF found with MAC fa:16:3e:95:b2:60, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.network.neutron [req-1e3cb2ef-7357-4454-877e-30088821bf34 req-c42a9e41-735a-4785-9737-c1a8895d324c service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Updated VIF entry in instance network info cache for port 74b9d20a-b195-4f89-8cae-b198549a6e7b. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG nova.network.neutron [req-1e3cb2ef-7357-4454-877e-30088821bf34 req-c42a9e41-735a-4785-9737-c1a8895d324c service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Updating instance_info_cache with network_info: [{"id": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "address": "fa:16:3e:95:b2:60", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b9d20a-b1", "ovs_interfaceid": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:16:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1e3cb2ef-7357-4454-877e-30088821bf34 req-c42a9e41-735a-4785-9737-c1a8895d324c service nova] Releasing lock "refresh_cache-47f331c2-4e12-45cc-8b9d-a566a0dbbca1" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:16:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:33 user nova-compute[74540]: DEBUG nova.compute.manager [req-52ebee0c-b5cc-4315-a1ba-849aab6d9e63 req-1f93070c-f5f1-4b49-ae16-a073ac497d61 service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Received event network-vif-plugged-74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:16:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-52ebee0c-b5cc-4315-a1ba-849aab6d9e63 req-1f93070c-f5f1-4b49-ae16-a073ac497d61 service nova] Acquiring lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-52ebee0c-b5cc-4315-a1ba-849aab6d9e63 req-1f93070c-f5f1-4b49-ae16-a073ac497d61 service nova] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-52ebee0c-b5cc-4315-a1ba-849aab6d9e63 req-1f93070c-f5f1-4b49-ae16-a073ac497d61 service nova] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:33 user nova-compute[74540]: DEBUG nova.compute.manager [req-52ebee0c-b5cc-4315-a1ba-849aab6d9e63 req-1f93070c-f5f1-4b49-ae16-a073ac497d61 service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] No waiting events found dispatching network-vif-plugged-74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:16:33 user nova-compute[74540]: WARNING nova.compute.manager [req-52ebee0c-b5cc-4315-a1ba-849aab6d9e63 req-1f93070c-f5f1-4b49-ae16-a073ac497d61 service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Received unexpected event network-vif-plugged-74b9d20a-b195-4f89-8cae-b198549a6e7b for instance with vm_state building and task_state spawning.
Nov 07 04:16:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG nova.compute.manager [req-9b92b1e9-64e7-45c9-8513-8b117136c5d9 req-d5ab9099-2451-4f53-a0ad-24b46c00119e service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Received event network-vif-plugged-74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9b92b1e9-64e7-45c9-8513-8b117136c5d9 req-d5ab9099-2451-4f53-a0ad-24b46c00119e service nova] Acquiring lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9b92b1e9-64e7-45c9-8513-8b117136c5d9 req-d5ab9099-2451-4f53-a0ad-24b46c00119e service nova] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9b92b1e9-64e7-45c9-8513-8b117136c5d9 req-d5ab9099-2451-4f53-a0ad-24b46c00119e service nova] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG nova.compute.manager [req-9b92b1e9-64e7-45c9-8513-8b117136c5d9 req-d5ab9099-2451-4f53-a0ad-24b46c00119e service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] No waiting events found dispatching network-vif-plugged-74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:16:36 user nova-compute[74540]: WARNING nova.compute.manager [req-9b92b1e9-64e7-45c9-8513-8b117136c5d9 req-d5ab9099-2451-4f53-a0ad-24b46c00119e service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Received unexpected event network-vif-plugged-74b9d20a-b195-4f89-8cae-b198549a6e7b for instance with vm_state building and task_state spawning.
Nov 07 04:16:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:16:36 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Instance spawned successfully.
Nov 07 04:16:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:16:36 user nova-compute[74540]: INFO nova.compute.manager [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 07 04:16:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:16:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:36 user nova-compute[74540]: INFO nova.compute.manager [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Took 6.57 seconds to build instance.
Nov 07 04:16:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-50753139-9b45-411a-ab81-6b27b73a6554 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.721s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:16:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:16:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:42 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:16:42 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:16:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:16:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:16:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:16:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:16:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:16:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:48 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:16:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:50 user nova-compute[74540]: INFO nova.compute.manager [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Terminating instance
Nov 07 04:16:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-411964f2-8a14-4f9e-9be4-4bd0b83e144f req-30247ada-b6e6-4ac3-bfe8-c5dffe18e529 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-vif-unplugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-411964f2-8a14-4f9e-9be4-4bd0b83e144f req-30247ada-b6e6-4ac3-bfe8-c5dffe18e529 service nova] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-411964f2-8a14-4f9e-9be4-4bd0b83e144f req-30247ada-b6e6-4ac3-bfe8-c5dffe18e529 service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-411964f2-8a14-4f9e-9be4-4bd0b83e144f req-30247ada-b6e6-4ac3-bfe8-c5dffe18e529 service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-411964f2-8a14-4f9e-9be4-4bd0b83e144f req-30247ada-b6e6-4ac3-bfe8-c5dffe18e529 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] No waiting events found dispatching network-vif-unplugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-411964f2-8a14-4f9e-9be4-4bd0b83e144f req-30247ada-b6e6-4ac3-bfe8-c5dffe18e529 service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-vif-unplugged-f06d373b-0587-4432-9c3b-8da8b7a99dac for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Instance destroyed successfully.
Nov 07 04:16:51 user nova-compute[74540]: DEBUG nova.objects.instance [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lazy-loading 'resources' on Instance uuid dc24a0b7-ff3c-482c-b0c5-0dcd70dda367 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T04:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746250716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746250716',id=28,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNChMQCLEy9+WuUP39ksN9q/qa3TqLb45LKZcHylN1OOkc1rkBz3INROxl/WpAAfTfI2AGIrUFbN9SI7GkWRLRakALvOyCI3Nz/jruNUIhLg9I+QxWS7piL60Vr0FmneGg==',key_name='tempest-keypair-24688172',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:15:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='796865203135404b8624363d533ae6fe',ramdisk_id='',reservation_id='r-oora9sqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-952443794',owner_user_name='tempest-AttachVolumeShelveTestJSON-952443794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:15:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47fad238078941dba4cc57406b1c69ed',uuid=dc24a0b7-ff3c-482c-b0c5-0dcd70dda367,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converting VIF {"id": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "address": "fa:16:3e:7e:23:61", "network": {"id": "38bbcfce-aaba-4549-9856-eeb3f62dbae8", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1068965138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796865203135404b8624363d533ae6fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf06d373b-05", "ovs_interfaceid": "f06d373b-0587-4432-9c3b-8da8b7a99dac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG os_vif [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf06d373b-05, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75024f53-45b9-41cd-a56d-f87541812522) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:16:51 user nova-compute[74540]: INFO os_vif [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:23:61,bridge_name='br-int',has_traffic_filtering=True,id=f06d373b-0587-4432-9c3b-8da8b7a99dac,network=Network(38bbcfce-aaba-4549-9856-eeb3f62dbae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf06d373b-05')
Nov 07 04:16:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Deleting instance files /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367_del
Nov 07 04:16:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Deletion of /opt/stack/data/nova/instances/dc24a0b7-ff3c-482c-b0c5-0dcd70dda367_del complete
Nov 07 04:16:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:51 user nova-compute[74540]: INFO nova.compute.manager [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG nova.compute.manager [req-14528dfa-256f-41e5-a79f-fa71e36564eb req-389a0b1e-7288-4e68-ad96-c98bae6f28cc service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Received event network-changed-b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG nova.compute.manager [req-14528dfa-256f-41e5-a79f-fa71e36564eb req-389a0b1e-7288-4e68-ad96-c98bae6f28cc service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Refreshing instance network info cache due to event network-changed-b3db2639-3be8-4213-88a7-7295fad36c80. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-14528dfa-256f-41e5-a79f-fa71e36564eb req-389a0b1e-7288-4e68-ad96-c98bae6f28cc service nova] Acquiring lock "refresh_cache-60104cc3-faf7-408c-8b95-7195ad105d3b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-14528dfa-256f-41e5-a79f-fa71e36564eb req-389a0b1e-7288-4e68-ad96-c98bae6f28cc service nova] Acquired lock "refresh_cache-60104cc3-faf7-408c-8b95-7195ad105d3b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG nova.network.neutron [req-14528dfa-256f-41e5-a79f-fa71e36564eb req-389a0b1e-7288-4e68-ad96-c98bae6f28cc service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Refreshing network info cache for port b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:51 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Error from libvirt while getting description of instance-0000001c: [Error Code 42] Domain not found: no domain with matching uuid 'dc24a0b7-ff3c-482c-b0c5-0dcd70dda367' (instance-0000001c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'dc24a0b7-ff3c-482c-b0c5-0dcd70dda367' (instance-0000001c)
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG nova.network.neutron [req-14528dfa-256f-41e5-a79f-fa71e36564eb req-389a0b1e-7288-4e68-ad96-c98bae6f28cc service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Updated VIF entry in instance network info cache for port b3db2639-3be8-4213-88a7-7295fad36c80. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG nova.network.neutron [req-14528dfa-256f-41e5-a79f-fa71e36564eb req-389a0b1e-7288-4e68-ad96-c98bae6f28cc service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Updating instance_info_cache with network_info: [{"id": "b3db2639-3be8-4213-88a7-7295fad36c80", "address": "fa:16:3e:35:18:90", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3db2639-3b", "ovs_interfaceid": "b3db2639-3be8-4213-88a7-7295fad36c80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-14528dfa-256f-41e5-a79f-fa71e36564eb req-389a0b1e-7288-4e68-ad96-c98bae6f28cc service nova] Releasing lock "refresh_cache-60104cc3-faf7-408c-8b95-7195ad105d3b" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-9f53e077-8d53-414a-bfb7-be7bb07a1c04 req-96cd21c5-7485-4d09-8b88-81a4d928369b service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9f53e077-8d53-414a-bfb7-be7bb07a1c04 req-96cd21c5-7485-4d09-8b88-81a4d928369b service nova] Acquiring lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9f53e077-8d53-414a-bfb7-be7bb07a1c04 req-96cd21c5-7485-4d09-8b88-81a4d928369b service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9f53e077-8d53-414a-bfb7-be7bb07a1c04 req-96cd21c5-7485-4d09-8b88-81a4d928369b service nova] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-9f53e077-8d53-414a-bfb7-be7bb07a1c04 req-96cd21c5-7485-4d09-8b88-81a4d928369b service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] No waiting events found dispatching network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:16:52 user nova-compute[74540]: WARNING nova.compute.manager [req-9f53e077-8d53-414a-bfb7-be7bb07a1c04 req-96cd21c5-7485-4d09-8b88-81a4d928369b service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received unexpected event network-vif-plugged-f06d373b-0587-4432-9c3b-8da8b7a99dac for instance with vm_state active and task_state deleting.
Nov 07 04:16:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-9f53e077-8d53-414a-bfb7-be7bb07a1c04 req-96cd21c5-7485-4d09-8b88-81a4d928369b service nova] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Received event network-vif-deleted-f06d373b-0587-4432-9c3b-8da8b7a99dac {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:16:52 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: dc24a0b7-ff3c-482c-b0c5-0dcd70dda367] Took 1.29 seconds to deallocate network for instance.
Nov 07 04:16:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.560s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:53 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:16:53 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:16:53 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7118MB free_disk=24.69738006591797GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:16:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:53 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:16:53 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:16:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.203s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.120s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:53 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Deleted allocations for instance dc24a0b7-ff3c-482c-b0c5-0dcd70dda367
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Applying migration context for instance bbed18c8-efc2-453e-825c-caf6a686c9cb as it has an incoming, in-progress migration cabd3358-493f-45d2-a277-9ce359ec26f9. Migration status is finished {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 07 04:16:54 user nova-compute[74540]: INFO nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updating resource usage from migration cabd3358-493f-45d2-a277-9ce359ec26f9
Nov 07 04:16:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0ce7d376-7fe2-42b2-bfac-280156bc3513 tempest-AttachVolumeShelveTestJSON-952443794 tempest-AttachVolumeShelveTestJSON-952443794-project-member] Lock "dc24a0b7-ff3c-482c-b0c5-0dcd70dda367" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.831s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 93ecf822-fcd9-41cc-97a3-3b92a49571da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 60104cc3-faf7-408c-8b95-7195ad105d3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance eab83056-14bd-4dd3-bcd0-7bc25cb8f722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Migration cabd3358-493f-45d2-a277-9ce359ec26f9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bbed18c8-efc2-453e-825c-caf6a686c9cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 7f2a213c-40b8-4a93-a6ae-e363fbc03496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 3f430e2c-d045-48b8-8266-76b8096995f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:16:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.639s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:16:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:16:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:16:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:16:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:16:55 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:16:55 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 9c425dfc-962a-4d21-ba9b-110fed764c51 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:16:56 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updating instance_info_cache with network_info: [{"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:16:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-9c425dfc-962a-4d21-ba9b-110fed764c51" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:16:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:16:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:16:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG nova.objects.instance [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 60104cc3-faf7-408c-8b95-7195ad105d3b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:16:58 user nova-compute[74540]: INFO nova.compute.manager [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Attaching volume 11489d3f-c8c8-4492-82d5-441eaa898719 to /dev/vdb
Nov 07 04:16:58 user nova-compute[74540]: DEBUG os_brick.utils [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7454f9e6-03bb-4392-b939-ee1fabf2bbc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[62495cc4-d21c-4ccc-ab58-aa71df3e1d11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f2a45a-f951-4c4c-9497-90b88ea92624]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f020fcc0-6e75-42f9-b8a5-7bc36979a811]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:16:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:16:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:16:59 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:16:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e043447-3b44-4017-841d-5d35f49c0f35]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:16:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:16:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:16:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:16:59 user nova-compute[74540]: DEBUG os_brick.utils [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:16:59 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Updating existing volume attachment record: 70e4cf92-69f6-4f1f-b227-606746f7f55e {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:17:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Acquiring lock "93ecf822-fcd9-41cc-97a3-3b92a49571da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Acquiring lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:02 user nova-compute[74540]: INFO nova.compute.manager [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Terminating instance
Nov 07 04:17:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-bc9e8bae-10bd-4ab1-b34d-80d4e017647e req-dd82a3fe-d655-44c1-840e-c35befe6b4fa service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Received event network-vif-unplugged-a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bc9e8bae-10bd-4ab1-b34d-80d4e017647e req-dd82a3fe-d655-44c1-840e-c35befe6b4fa service nova] Acquiring lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bc9e8bae-10bd-4ab1-b34d-80d4e017647e req-dd82a3fe-d655-44c1-840e-c35befe6b4fa service nova] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bc9e8bae-10bd-4ab1-b34d-80d4e017647e req-dd82a3fe-d655-44c1-840e-c35befe6b4fa service nova] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-bc9e8bae-10bd-4ab1-b34d-80d4e017647e req-dd82a3fe-d655-44c1-840e-c35befe6b4fa service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] No waiting events found dispatching network-vif-unplugged-a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-bc9e8bae-10bd-4ab1-b34d-80d4e017647e req-dd82a3fe-d655-44c1-840e-c35befe6b4fa service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Received event network-vif-unplugged-a81b28d3-914c-4570-a633-b062f9e351e6 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:17:02 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Instance destroyed successfully.
Nov 07 04:17:02 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lazy-loading 'resources' on Instance uuid 93ecf822-fcd9-41cc-97a3-3b92a49571da {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1083884345',display_name='tempest-VolumesActionsTest-instance-1083884345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1083884345',id=32,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:14:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc7db70c9ecb4ec9bee371401852de5e',ramdisk_id='',reservation_id='r-85ptj6fu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-885401094',owner_user_name='tempest-VolumesActionsTest-885401094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:14:59Z,user_data=None,user_id='2b4e00e8bf1c48a99a973405f8d55237',uuid=93ecf822-fcd9-41cc-97a3-3b92a49571da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a81b28d3-914c-4570-a633-b062f9e351e6", "address": "fa:16:3e:79:d8:7e", "network": {"id": "6e71c4f4-8055-40f3-bc5f-f3c806c758f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-702351221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc7db70c9ecb4ec9bee371401852de5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b28d3-91", "ovs_interfaceid": "a81b28d3-914c-4570-a633-b062f9e351e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Converting VIF {"id": "a81b28d3-914c-4570-a633-b062f9e351e6", "address": "fa:16:3e:79:d8:7e", "network": {"id": "6e71c4f4-8055-40f3-bc5f-f3c806c758f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-702351221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc7db70c9ecb4ec9bee371401852de5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa81b28d3-91", "ovs_interfaceid": "a81b28d3-914c-4570-a633-b062f9e351e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:d8:7e,bridge_name='br-int',has_traffic_filtering=True,id=a81b28d3-914c-4570-a633-b062f9e351e6,network=Network(6e71c4f4-8055-40f3-bc5f-f3c806c758f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b28d3-91') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG os_vif [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:d8:7e,bridge_name='br-int',has_traffic_filtering=True,id=a81b28d3-914c-4570-a633-b062f9e351e6,network=Network(6e71c4f4-8055-40f3-bc5f-f3c806c758f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b28d3-91') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa81b28d3-91, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0e3d5a9-db3e-465d-94f4-1497f5f4c873) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:02 user nova-compute[74540]: INFO os_vif [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:d8:7e,bridge_name='br-int',has_traffic_filtering=True,id=a81b28d3-914c-4570-a633-b062f9e351e6,network=Network(6e71c4f4-8055-40f3-bc5f-f3c806c758f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa81b28d3-91')
Nov 07 04:17:02 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Deleting instance files /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da_del
Nov 07 04:17:02 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Deletion of /opt/stack/data/nova/instances/93ecf822-fcd9-41cc-97a3-3b92a49571da_del complete
Nov 07 04:17:02 user nova-compute[74540]: INFO nova.compute.manager [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 07 04:17:02 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:17:02 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:17:03 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:17:03 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Took 0.56 seconds to deallocate network for instance.
Nov 07 04:17:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:03 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:17:03 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:17:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:03 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Deleted allocations for instance 93ecf822-fcd9-41cc-97a3-3b92a49571da
Nov 07 04:17:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d9856d7b-acc7-4041-a04c-7224f6369300 tempest-VolumesActionsTest-885401094 tempest-VolumesActionsTest-885401094-project-member] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.027s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-ecda4556-9984-434b-b07e-e22fd4e84fdb req-44e3e666-12e7-4937-ae7a-99e7e7a03884 service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Received event network-vif-plugged-a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:17:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ecda4556-9984-434b-b07e-e22fd4e84fdb req-44e3e666-12e7-4937-ae7a-99e7e7a03884 service nova] Acquiring lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ecda4556-9984-434b-b07e-e22fd4e84fdb req-44e3e666-12e7-4937-ae7a-99e7e7a03884 service nova] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ecda4556-9984-434b-b07e-e22fd4e84fdb req-44e3e666-12e7-4937-ae7a-99e7e7a03884 service nova] Lock "93ecf822-fcd9-41cc-97a3-3b92a49571da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-ecda4556-9984-434b-b07e-e22fd4e84fdb req-44e3e666-12e7-4937-ae7a-99e7e7a03884 service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] No waiting events found dispatching network-vif-plugged-a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:17:04 user nova-compute[74540]: WARNING nova.compute.manager [req-ecda4556-9984-434b-b07e-e22fd4e84fdb req-44e3e666-12e7-4937-ae7a-99e7e7a03884 service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Received unexpected event network-vif-plugged-a81b28d3-914c-4570-a633-b062f9e351e6 for instance with vm_state deleted and task_state None.
Nov 07 04:17:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-ecda4556-9984-434b-b07e-e22fd4e84fdb req-44e3e666-12e7-4937-ae7a-99e7e7a03884 service nova] [instance: 93ecf822-fcd9-41cc-97a3-3b92a49571da] Received event network-vif-deleted-a81b28d3-914c-4570-a633-b062f9e351e6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:17:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:10 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:17:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:10 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:17:10 user nova-compute[74540]: INFO nova.compute.claims [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Claim successful on node user
Nov 07 04:17:11 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:17:11 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:17:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG nova.policy [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b1fde560d4146e48532693afb044a41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8c4c299b1b74a68a93a3f373067051f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:17:11 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Creating image(s)
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "/opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "/opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.172s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk 1073741824" returned: 0 in 0.060s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:11 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Successfully created port: e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Cannot resize image /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Ensure instance console log exists: /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Successfully updated port: e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "refresh_cache-7d0cce7c-b661-45d8-a197-6a8aa81c1b1f" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquired lock "refresh_cache-7d0cce7c-b661-45d8-a197-6a8aa81c1b1f" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-20f17983-7c12-4b77-8583-931a27335f4c req-d6a833fb-86a1-494d-865d-6b03b6a70bab service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Received event network-changed-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.compute.manager [req-20f17983-7c12-4b77-8583-931a27335f4c req-d6a833fb-86a1-494d-865d-6b03b6a70bab service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Refreshing instance network info cache due to event network-changed-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-20f17983-7c12-4b77-8583-931a27335f4c req-d6a833fb-86a1-494d-865d-6b03b6a70bab service nova] Acquiring lock "refresh_cache-7d0cce7c-b661-45d8-a197-6a8aa81c1b1f" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Updating instance_info_cache with network_info: [{"id": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "address": "fa:16:3e:61:4f:d0", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2366a5f-65", "ovs_interfaceid": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Releasing lock "refresh_cache-7d0cce7c-b661-45d8-a197-6a8aa81c1b1f" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Instance network_info: |[{"id": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "address": "fa:16:3e:61:4f:d0", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2366a5f-65", "ovs_interfaceid": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-20f17983-7c12-4b77-8583-931a27335f4c req-d6a833fb-86a1-494d-865d-6b03b6a70bab service nova] Acquired lock "refresh_cache-7d0cce7c-b661-45d8-a197-6a8aa81c1b1f" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.network.neutron [req-20f17983-7c12-4b77-8583-931a27335f4c req-d6a833fb-86a1-494d-865d-6b03b6a70bab service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Refreshing network info cache for port e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Start _get_guest_xml network_info=[{"id": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "address": "fa:16:3e:61:4f:d0", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2366a5f-65", "ovs_interfaceid": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:17:12 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:17:12 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:17:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:17:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1245162047',display_name='tempest-ServersNegativeTestJSON-server-1245162047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1245162047',id=38,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c4c299b1b74a68a93a3f373067051f',ramdisk_id='',reservation_id='r-djarkpus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-640893805',owner_user_name='tempest-ServersNegativeTestJSON-640893805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:17:11Z,user_data=None,user_id='8b1fde560d4146e48532693afb044a41',uuid=7d0cce7c-b661-45d8-a197-6a8aa81c1b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "address": "fa:16:3e:61:4f:d0", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2366a5f-65", "ovs_interfaceid": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Converting VIF {"id": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "address": "fa:16:3e:61:4f:d0", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2366a5f-65", "ovs_interfaceid": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:4f:d0,bridge_name='br-int',has_traffic_filtering=True,id=e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2366a5f-65') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:17:13 user nova-compute[74540]:   <uuid>7d0cce7c-b661-45d8-a197-6a8aa81c1b1f</uuid>
Nov 07 04:17:13 user nova-compute[74540]:   <name>instance-00000026</name>
Nov 07 04:17:13 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:17:13 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:17:13 user nova-compute[74540]:   <metadata>
Nov 07 04:17:13 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:17:13 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:17:13 user nova-compute[74540]:       <nova:name>tempest-ServersNegativeTestJSON-server-1245162047</nova:name>
Nov 07 04:17:13 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:17:12</nova:creationTime>
Nov 07 04:17:13 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:17:13 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:17:13 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:17:13 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:17:13 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:17:13 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:17:13 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:17:13 user nova-compute[74540]:       <nova:owner>
Nov 07 04:17:13 user nova-compute[74540]:         <nova:user uuid="8b1fde560d4146e48532693afb044a41">tempest-ServersNegativeTestJSON-640893805-project-member</nova:user>
Nov 07 04:17:13 user nova-compute[74540]:         <nova:project uuid="d8c4c299b1b74a68a93a3f373067051f">tempest-ServersNegativeTestJSON-640893805</nova:project>
Nov 07 04:17:13 user nova-compute[74540]:       </nova:owner>
Nov 07 04:17:13 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:17:13 user nova-compute[74540]:       <nova:ports>
Nov 07 04:17:13 user nova-compute[74540]:         <nova:port uuid="e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6">
Nov 07 04:17:13 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:17:13 user nova-compute[74540]:         </nova:port>
Nov 07 04:17:13 user nova-compute[74540]:       </nova:ports>
Nov 07 04:17:13 user nova-compute[74540]:     </nova:instance>
Nov 07 04:17:13 user nova-compute[74540]:   </metadata>
Nov 07 04:17:13 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:17:13 user nova-compute[74540]:     <system>
Nov 07 04:17:13 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:17:13 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:17:13 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:17:13 user nova-compute[74540]:       <entry name="serial">7d0cce7c-b661-45d8-a197-6a8aa81c1b1f</entry>
Nov 07 04:17:13 user nova-compute[74540]:       <entry name="uuid">7d0cce7c-b661-45d8-a197-6a8aa81c1b1f</entry>
Nov 07 04:17:13 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:17:13 user nova-compute[74540]:     </system>
Nov 07 04:17:13 user nova-compute[74540]:   </sysinfo>
Nov 07 04:17:13 user nova-compute[74540]:   <os>
Nov 07 04:17:13 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:17:13 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:17:13 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:17:13 user nova-compute[74540]:   </os>
Nov 07 04:17:13 user nova-compute[74540]:   <features>
Nov 07 04:17:13 user nova-compute[74540]:     <acpi/>
Nov 07 04:17:13 user nova-compute[74540]:     <apic/>
Nov 07 04:17:13 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:17:13 user nova-compute[74540]:   </features>
Nov 07 04:17:13 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:17:13 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:17:13 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:17:13 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:17:13 user nova-compute[74540]:   </clock>
Nov 07 04:17:13 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:17:13 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:17:13 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:17:13 user nova-compute[74540]:   </cpu>
Nov 07 04:17:13 user nova-compute[74540]:   <devices>
Nov 07 04:17:13 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:17:13 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:17:13 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk"/>
Nov 07 04:17:13 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:17:13 user nova-compute[74540]:     </disk>
Nov 07 04:17:13 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:17:13 user nova-compute[74540]:       <mac address="fa:16:3e:61:4f:d0"/>
Nov 07 04:17:13 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:17:13 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:17:13 user nova-compute[74540]:       <target dev="tape2366a5f-65"/>
Nov 07 04:17:13 user nova-compute[74540]:     </interface>
Nov 07 04:17:13 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:17:13 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/console.log" append="off"/>
Nov 07 04:17:13 user nova-compute[74540]:     </serial>
Nov 07 04:17:13 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:17:13 user nova-compute[74540]:     <video>
Nov 07 04:17:13 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:17:13 user nova-compute[74540]:     </video>
Nov 07 04:17:13 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:17:13 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:17:13 user nova-compute[74540]:     </rng>
Nov 07 04:17:13 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:17:13 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:17:13 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:17:13 user nova-compute[74540]:     </memballoon>
Nov 07 04:17:13 user nova-compute[74540]:   </devices>
Nov 07 04:17:13 user nova-compute[74540]: </domain>
Nov 07 04:17:13 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:17:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1245162047',display_name='tempest-ServersNegativeTestJSON-server-1245162047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1245162047',id=38,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8c4c299b1b74a68a93a3f373067051f',ramdisk_id='',reservation_id='r-djarkpus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-640893805',owner_user_name='tempest-ServersNegativeTestJSON-640893805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:17:11Z,user_data=None,user_id='8b1fde560d4146e48532693afb044a41',uuid=7d0cce7c-b661-45d8-a197-6a8aa81c1b1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "address": "fa:16:3e:61:4f:d0", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2366a5f-65", "ovs_interfaceid": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Converting VIF {"id": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "address": "fa:16:3e:61:4f:d0", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2366a5f-65", "ovs_interfaceid": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:4f:d0,bridge_name='br-int',has_traffic_filtering=True,id=e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2366a5f-65') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG os_vif [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:4f:d0,bridge_name='br-int',has_traffic_filtering=True,id=e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2366a5f-65') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '130becd5-f5ca-541a-8e6a-2f43488acf75', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2366a5f-65, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2366a5f-65, col_values=(('qos', UUID('c6e486ea-c74f-4ff3-9f62-266e735e8410')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2366a5f-65, col_values=(('external_ids', {'iface-id': 'e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:4f:d0', 'vm-uuid': '7d0cce7c-b661-45d8-a197-6a8aa81c1b1f'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:13 user nova-compute[74540]: INFO os_vif [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:4f:d0,bridge_name='br-int',has_traffic_filtering=True,id=e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2366a5f-65')
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] No VIF found with MAC fa:16:3e:61:4f:d0, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Going to confirm migration 2 {{(pid=74540) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.network.neutron [req-20f17983-7c12-4b77-8583-931a27335f4c req-d6a833fb-86a1-494d-865d-6b03b6a70bab service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Updated VIF entry in instance network info cache for port e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.network.neutron [req-20f17983-7c12-4b77-8583-931a27335f4c req-d6a833fb-86a1-494d-865d-6b03b6a70bab service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Updating instance_info_cache with network_info: [{"id": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "address": "fa:16:3e:61:4f:d0", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2366a5f-65", "ovs_interfaceid": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-20f17983-7c12-4b77-8583-931a27335f4c req-d6a833fb-86a1-494d-865d-6b03b6a70bab service nova] Releasing lock "refresh_cache-7d0cce7c-b661-45d8-a197-6a8aa81c1b1f" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquired lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.network.neutron [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:17:13 user nova-compute[74540]: DEBUG nova.objects.instance [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lazy-loading 'info_cache' on Instance uuid bbed18c8-efc2-453e-825c-caf6a686c9cb {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG nova.network.neutron [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updating instance_info_cache with network_info: [{"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Releasing lock "refresh_cache-bbed18c8-efc2-453e-825c-caf6a686c9cb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG nova.objects.instance [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lazy-loading 'migration_context' on Instance uuid bbed18c8-efc2-453e-825c-caf6a686c9cb {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG nova.objects.base [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Object Instance<bbed18c8-efc2-453e-825c-caf6a686c9cb> lazy-loaded attributes: info_cache,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.514s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:14 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Deleted allocation for migration cabd3358-493f-45d2-a277-9ce359ec26f9
Nov 07 04:17:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-25222c93-d601-42df-9f55-dedc365b2418 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.577s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-e2b71a20-84a2-4b3b-a61e-8e998063d374 req-83a5baaf-b1ec-49fb-abd7-fc74fe0cee5a service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Received event network-vif-plugged-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:17:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e2b71a20-84a2-4b3b-a61e-8e998063d374 req-83a5baaf-b1ec-49fb-abd7-fc74fe0cee5a service nova] Acquiring lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e2b71a20-84a2-4b3b-a61e-8e998063d374 req-83a5baaf-b1ec-49fb-abd7-fc74fe0cee5a service nova] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e2b71a20-84a2-4b3b-a61e-8e998063d374 req-83a5baaf-b1ec-49fb-abd7-fc74fe0cee5a service nova] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-e2b71a20-84a2-4b3b-a61e-8e998063d374 req-83a5baaf-b1ec-49fb-abd7-fc74fe0cee5a service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] No waiting events found dispatching network-vif-plugged-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:17:15 user nova-compute[74540]: WARNING nova.compute.manager [req-e2b71a20-84a2-4b3b-a61e-8e998063d374 req-83a5baaf-b1ec-49fb-abd7-fc74fe0cee5a service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Received unexpected event network-vif-plugged-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 for instance with vm_state building and task_state spawning.
Nov 07 04:17:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:17:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:17:16 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Instance spawned successfully.
Nov 07 04:17:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:17:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:17:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:17:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:17:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:17:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:17:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:17:16 user nova-compute[74540]: INFO nova.compute.manager [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 07 04:17:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:17:17 user nova-compute[74540]: INFO nova.compute.manager [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Took 6.41 seconds to build instance.
Nov 07 04:17:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f83e1bcb-4e8d-4bf0-b541-ba567c7c6a5c tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.514s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-9c9cb561-a859-451d-8d05-531e538e148e req-7c87b1fb-dadc-4c76-a154-d0af8c3748f3 service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Received event network-vif-plugged-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:17:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9c9cb561-a859-451d-8d05-531e538e148e req-7c87b1fb-dadc-4c76-a154-d0af8c3748f3 service nova] Acquiring lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9c9cb561-a859-451d-8d05-531e538e148e req-7c87b1fb-dadc-4c76-a154-d0af8c3748f3 service nova] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-9c9cb561-a859-451d-8d05-531e538e148e req-7c87b1fb-dadc-4c76-a154-d0af8c3748f3 service nova] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-9c9cb561-a859-451d-8d05-531e538e148e req-7c87b1fb-dadc-4c76-a154-d0af8c3748f3 service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] No waiting events found dispatching network-vif-plugged-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:17:17 user nova-compute[74540]: WARNING nova.compute.manager [req-9c9cb561-a859-451d-8d05-531e538e148e req-7c87b1fb-dadc-4c76-a154-d0af8c3748f3 service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Received unexpected event network-vif-plugged-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 for instance with vm_state active and task_state None.
Nov 07 04:17:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQuESeWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:17:21 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:17:21 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:17:21 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f049c60-0a44-47e5-8c95-16dee7a427c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:17:21 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5425f8-cf46-49d7-b17a-698746513eb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719] added
Nov 07 04:17:21 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4da997e-be5d-4cf1-8c9e-0e9400aaa934]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffff29ee-470f-4800-8223-2e3afc0503cc]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQuESeWm {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQuESeWm" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e861e09-04b0-4ee9-a86c-480b20b77ee2]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YQuESeWm'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[363e7fc2-6f21-4ddb-9ff9-23bb0e0f265c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ee716b-f746-4d69-b9e7-87f1081e4bff]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:17:21 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:17:21 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:17:21 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:17:21 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c588b61f-86cf-445e-a58d-ba375d2e5040]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719, portal: 172.16.0.220,3260]
Nov 07 04:17:21 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719, portal: 172.16.0.220,3260] successful.
Nov 07 04:17:21 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c72458-1c2a-4341-82c8-0687dcd033b5]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[319bc4b9-ad4f-4f3d-a88c-05400e4d56f1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:17:21 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:17:21 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:17:21 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:17:21 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:17:21 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:17:21 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[369aef12-1f3e-485b-a970-e7a7602ce9d6]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:17:21 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQuESeWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:17:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:17:22 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23263306630303435', 'path': '/dev/sdd'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:17:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263306630303435', 'path': '/dev/sdd'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:17:22 user nova-compute[74540]: DEBUG nova.objects.instance [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 60104cc3-faf7-408c-8b95-7195ad105d3b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:17:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:17:22 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:17:22 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:17:22 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:17:22 user nova-compute[74540]:   <serial>11489d3f-c8c8-4492-82d5-441eaa898719</serial>
Nov 07 04:17:22 user nova-compute[74540]: </disk>
Nov 07 04:17:22 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:17:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:17:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:17:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:17:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:17:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:17:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:17:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:17:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No VIF found with MAC fa:16:3e:35:18:90, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:17:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2a9edd03-ab3b-49f3-91bf-2dade7f8a6a9 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.785s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 60104cc3-faf7-408c-8b95-7195ad105d3b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:30 user nova-compute[74540]: INFO nova.compute.manager [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Attaching volume 5f8e51a3-6ced-4baa-91ed-e5189e5af866 to /dev/vdc
Nov 07 04:17:30 user nova-compute[74540]: DEBUG os_brick.utils [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[005e6205-cb7e-4f86-aca8-f3b8fb315416]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c944e57-1edc-4e98-be34-27506f4c4870]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[590df64b-7af5-455e-9bc8-88783e7e39d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5a713c-749e-4b01-97cd-875ef72c06ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:17:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:17:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:17:31 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:17:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[992df055-c279-45f2-bfe2-e63908cfa54d]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:17:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:17:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:17:31 user nova-compute[74540]: DEBUG os_brick.utils [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:17:31 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Updating existing volume attachment record: 084673d3-5484-4e34-a0da-def200d2f8b5 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:17:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:17:40 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:17:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-7f67d805-ed4f-4953-be4b-dd003bc47109 req-124f0813-6628-4f02-8b0c-713762c75c04 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Received event network-changed-75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:17:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-7f67d805-ed4f-4953-be4b-dd003bc47109 req-124f0813-6628-4f02-8b0c-713762c75c04 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Refreshing instance network info cache due to event network-changed-75a1d34f-2b29-46d6-a97c-107793dfb129. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:17:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7f67d805-ed4f-4953-be4b-dd003bc47109 req-124f0813-6628-4f02-8b0c-713762c75c04 service nova] Acquiring lock "refresh_cache-7f2a213c-40b8-4a93-a6ae-e363fbc03496" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:17:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7f67d805-ed4f-4953-be4b-dd003bc47109 req-124f0813-6628-4f02-8b0c-713762c75c04 service nova] Acquired lock "refresh_cache-7f2a213c-40b8-4a93-a6ae-e363fbc03496" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:17:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-7f67d805-ed4f-4953-be4b-dd003bc47109 req-124f0813-6628-4f02-8b0c-713762c75c04 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Refreshing network info cache for port 75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:17:41 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:17:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74540) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 04:17:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:41 user nova-compute[74540]: DEBUG nova.objects.instance [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lazy-loading 'flavor' on Instance uuid 7f2a213c-40b8-4a93-a6ae-e363fbc03496 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:17:41 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Ignoring supplied device name: /dev/vdb
Nov 07 04:17:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG nova.network.neutron [req-7f67d805-ed4f-4953-be4b-dd003bc47109 req-124f0813-6628-4f02-8b0c-713762c75c04 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Updated VIF entry in instance network info cache for port 75a1d34f-2b29-46d6-a97c-107793dfb129. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG nova.network.neutron [req-7f67d805-ed4f-4953-be4b-dd003bc47109 req-124f0813-6628-4f02-8b0c-713762c75c04 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Updating instance_info_cache with network_info: [{"id": "75a1d34f-2b29-46d6-a97c-107793dfb129", "address": "fa:16:3e:e5:4e:85", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a1d34f-2b", "ovs_interfaceid": "75a1d34f-2b29-46d6-a97c-107793dfb129", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7f67d805-ed4f-4953-be4b-dd003bc47109 req-124f0813-6628-4f02-8b0c-713762c75c04 service nova] Releasing lock "refresh_cache-7f2a213c-40b8-4a93-a6ae-e363fbc03496" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:42 user nova-compute[74540]: INFO nova.compute.manager [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Attaching volume d84bd96d-3cf4-4be0-9e25-1fd6aa58961a to /dev/vdb
Nov 07 04:17:42 user nova-compute[74540]: DEBUG os_brick.utils [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8a2063-8dea-41d8-9f66-7e560e282b24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3551683f-816c-4a26-9dd9-9002be7f903a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[06155e78-eead-45b4-83a6-48b8d8e83cbc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2111719f-c864-434d-8e52-cd4eccec72a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:17:42 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ae8e5f-0ba7-49ec-9824-c470f0ec1d79]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG os_brick.utils [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Updating existing volume attachment record: 8d044632-d3ac-4a43-9957-ad94d3a844e2 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:17:42 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:17:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:43 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:17:43 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:17:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 04:17:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] There are 0 instances to clean {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 04:17:45 user nova-compute[74540]: DEBUG nova.compute.manager [req-bc787f59-d8b7-427d-b34b-3cbf89d33900 req-c2028f66-3164-4f12-b8c5-79217f5a1591 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received event network-changed-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:17:45 user nova-compute[74540]: DEBUG nova.compute.manager [req-bc787f59-d8b7-427d-b34b-3cbf89d33900 req-c2028f66-3164-4f12-b8c5-79217f5a1591 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Refreshing instance network info cache due to event network-changed-3d22bce5-b4e4-433c-a8bf-e25013902730. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:17:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bc787f59-d8b7-427d-b34b-3cbf89d33900 req-c2028f66-3164-4f12-b8c5-79217f5a1591 service nova] Acquiring lock "refresh_cache-3f430e2c-d045-48b8-8266-76b8096995f0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:17:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bc787f59-d8b7-427d-b34b-3cbf89d33900 req-c2028f66-3164-4f12-b8c5-79217f5a1591 service nova] Acquired lock "refresh_cache-3f430e2c-d045-48b8-8266-76b8096995f0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:17:45 user nova-compute[74540]: DEBUG nova.network.neutron [req-bc787f59-d8b7-427d-b34b-3cbf89d33900 req-c2028f66-3164-4f12-b8c5-79217f5a1591 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Refreshing network info cache for port 3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:17:45 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:17:45 user nova-compute[74540]: DEBUG nova.network.neutron [req-bc787f59-d8b7-427d-b34b-3cbf89d33900 req-c2028f66-3164-4f12-b8c5-79217f5a1591 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Updated VIF entry in instance network info cache for port 3d22bce5-b4e4-433c-a8bf-e25013902730. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:17:45 user nova-compute[74540]: DEBUG nova.network.neutron [req-bc787f59-d8b7-427d-b34b-3cbf89d33900 req-c2028f66-3164-4f12-b8c5-79217f5a1591 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Updating instance_info_cache with network_info: [{"id": "3d22bce5-b4e4-433c-a8bf-e25013902730", "address": "fa:16:3e:7d:d5:46", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d22bce5-b4", "ovs_interfaceid": "3d22bce5-b4e4-433c-a8bf-e25013902730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:17:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bc787f59-d8b7-427d-b34b-3cbf89d33900 req-c2028f66-3164-4f12-b8c5-79217f5a1591 service nova] Releasing lock "refresh_cache-3f430e2c-d045-48b8-8266-76b8096995f0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "3f430e2c-d045-48b8-8266-76b8096995f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "3f430e2c-d045-48b8-8266-76b8096995f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG nova.objects.instance [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lazy-loading 'flavor' on Instance uuid 3f430e2c-d045-48b8-8266-76b8096995f0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "3f430e2c-d045-48b8-8266-76b8096995f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "3f430e2c-d045-48b8-8266-76b8096995f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "3f430e2c-d045-48b8-8266-76b8096995f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:46 user nova-compute[74540]: INFO nova.compute.manager [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Attaching volume 73724c8e-8a48-472b-b102-56816e2f1526 to /dev/vdb
Nov 07 04:17:46 user nova-compute[74540]: DEBUG os_brick.utils [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5757b8-03eb-4039-8bad-7318f86fe2a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4873ed2a-ee63-4c04-a508-24e5c178fe6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe9b513-5b80-4423-8e6d-0704edd60ef1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abf3e04-542b-47b5-a278-bf0551e2918f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:17:46 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[982e34a7-b822-4fa2-b5c6-84fe64330a63]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG os_brick.utils [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Updating existing volume attachment record: 7c6d694a-37ae-4890-aaf0-9ac0db836128 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:17:46 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:17:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:49 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:17:49 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:17:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:49 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:17:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:17:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:17:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:17:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPQRfMal', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:17:54 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:17:54 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:17:54 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:17:54 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:17:54 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7421MB free_disk=24.685768127441406GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d55286-613d-4614-831d-15410462465e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:17:54 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ab3b00-26f8-49cc-a8a7-9d6b32df3dff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866] added
Nov 07 04:17:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8e4e97-0ed0-49be-8296-feb0e2001b9d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6979bc-c0db-4148-b3cd-2e4b4612b2ee]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPQRfMal {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPQRfMal" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e813995-eb8b-4e64-9b8a-08d6a0e6a740]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pPQRfMal'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecadf05-d634-4bbb-b52d-aae4394a51d1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c30f826-d8ee-4332-9dd2-38421860ac8b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeed244-54d1-4889-8a17-379dcb053130]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866, portal: 172.16.0.220,3260]
Nov 07 04:17:54 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866, portal: 172.16.0.220,3260] successful.
Nov 07 04:17:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cc297b-ef0c-4820-89e5-f6fbb99bb8bb]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 60104cc3-faf7-408c-8b95-7195ad105d3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance eab83056-14bd-4dd3-bcd0-7bc25cb8f722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bbed18c8-efc2-453e-825c-caf6a686c9cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 7f2a213c-40b8-4a93-a6ae-e363fbc03496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 3f430e2c-d045-48b8-8266-76b8096995f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4df8a92-6e39-4973-bb71-bdc75d28f959]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:17:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing inventories for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3fcf4a-cf74-4930-9fac-8059a329db50]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPQRfMal', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating ProviderTree inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing aggregate associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, aggregates: None {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 04:17:54 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing trait associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.989s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23830373938393634', 'path': '/dev/sde'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830373938393634', 'path': '/dev/sde'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 60104cc3-faf7-408c-8b95-7195ad105d3b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:17:55 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:17:55 user nova-compute[74540]:   <source dev="/dev/sde"/>
Nov 07 04:17:55 user nova-compute[74540]:   <target dev="vdc" bus="virtio"/>
Nov 07 04:17:55 user nova-compute[74540]:   <serial>5f8e51a3-6ced-4baa-91ed-e5189e5af866</serial>
Nov 07 04:17:55 user nova-compute[74540]: </disk>
Nov 07 04:17:55 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:17:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] No VIF found with MAC fa:16:3e:35:18:90, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:17:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:17:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:17:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:17:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:17:56 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:17:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d7c9d7a8-7255-4876-9ed0-432a3e7ff280 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.409s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:17:56 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updating instance_info_cache with network_info: [{"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:17:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:17:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:17:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:17:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:17:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:17:57 user nova-compute[74540]: INFO nova.compute.manager [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Detaching volume 11489d3f-c8c8-4492-82d5-441eaa898719
Nov 07 04:17:57 user nova-compute[74540]: INFO nova.virt.block_device [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Attempting to driver detach volume 11489d3f-c8c8-4492-82d5-441eaa898719 from mountpoint /dev/vdb
Nov 07 04:17:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Attempting to detach device vdb from instance 60104cc3-faf7-408c-8b95-7195ad105d3b from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:17:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:17:57 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:17:57 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:17:57 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:17:57 user nova-compute[74540]:   <serial>11489d3f-c8c8-4492-82d5-441eaa898719</serial>
Nov 07 04:17:57 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:17:57 user nova-compute[74540]: </disk>
Nov 07 04:17:57 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:17:57 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully detached device vdb from instance 60104cc3-faf7-408c-8b95-7195ad105d3b from the persistent domain config.
Nov 07 04:17:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60104cc3-faf7-408c-8b95-7195ad105d3b from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:17:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:17:57 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:17:57 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:17:57 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:17:57 user nova-compute[74540]:   <serial>11489d3f-c8c8-4492-82d5-441eaa898719</serial>
Nov 07 04:17:57 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:17:57 user nova-compute[74540]: </disk>
Nov 07 04:17:57 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:17:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:17:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60104cc3-faf7-408c-8b95-7195ad105d3b {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:18:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIelaLoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:18:06 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:18:06 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:18:06 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[499da2e7-68a4-4383-9863-88b063e0ab66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:18:06 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06e09e8-96c6-4191-8585-a14794f24d36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a] added
Nov 07 04:18:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8e59e6-05bd-4a7b-b0f8-4aac15c240eb]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4414bb6-8d27-49c4-a40c-935153e35a6f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIelaLoR {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIelaLoR" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a35f3d-e59e-4b37-be6b-994ca3d4289a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vIelaLoR'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c653ca90-dac8-47ab-b3f4-f7d871161f6d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[811171cf-e351-46f8-81cf-713af79b5317]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[51976278-dbcf-4854-bfa6-6be9fbd10f66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a, portal: 172.16.0.220,3260]
Nov 07 04:18:06 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a, portal: 172.16.0.220,3260] successful.
Nov 07 04:18:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2097ad1f-e19f-4501-8bfd-8febc8f20835]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42af684-2d2c-4bd6-bc06-5272ab3b20b9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:18:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:06 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:18:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[17966f68-3208-4b28-9940-53212b71ab61]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:18:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIelaLoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:18:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:18:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23331366439613861', 'path': '/dev/sdf'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:18:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331366439613861', 'path': '/dev/sdf'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:18:07 user nova-compute[74540]: DEBUG nova.objects.instance [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lazy-loading 'flavor' on Instance uuid 7f2a213c-40b8-4a93-a6ae-e363fbc03496 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:18:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:18:07 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:18:07 user nova-compute[74540]:   <source dev="/dev/sdf"/>
Nov 07 04:18:07 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:18:07 user nova-compute[74540]:   <serial>d84bd96d-3cf4-4be0-9e25-1fd6aa58961a</serial>
Nov 07 04:18:07 user nova-compute[74540]: </disk>
Nov 07 04:18:07 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:18:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:18:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:18:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:18:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:18:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:18:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:08 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:18:08 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:18:08 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] No VIF found with MAC fa:16:3e:e5:4e:85, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:18:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f446dcd-d2df-4350-982a-4214318fbfc7 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.224s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:18:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFIXPDCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:18:10 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:18:10 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:18:10 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a947d6-13ce-4b7c-a3fe-79ddb22fd460]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:18:10 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5de621-14f3-45ad-b9b3-30dc070c827d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526] added
Nov 07 04:18:10 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb175429-1566-4203-94ab-f156a8a8fe1d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf34bbea-21c9-4e31-b139-5caca8a78503]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFIXPDCl {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFIXPDCl" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f663dd-52b5-46ac-95a1-e4cdd8b7cced]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mFIXPDCl'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[08226149-944f-45c1-b193-5a0a5366e694]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2213294-5417-4758-81df-248b32570df8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:18:10 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:18:10 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79f4f86-b229-45ed-bd87-2c1842175d6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526, portal: 172.16.0.220,3260]
Nov 07 04:18:10 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526, portal: 172.16.0.220,3260] successful.
Nov 07 04:18:10 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bb9a77-491f-4679-b302-ded78e61e48c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[610a1e6d-1d61-420a-9b4b-f31ea5c0afb2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:18:10 user nova-compute[74540]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 (non-flash)
Nov 07 04:18:10 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe7684e-3101-4ec4-8b1f-9b57e4f17c5b]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:10 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:18:11 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:18:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFIXPDCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:18:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:18:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26536633262306236', 'path': '/dev/sdg'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:18:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536633262306236', 'path': '/dev/sdg'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:18:11 user nova-compute[74540]: DEBUG nova.objects.instance [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lazy-loading 'flavor' on Instance uuid 3f430e2c-d045-48b8-8266-76b8096995f0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:18:11 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:18:11 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:18:11 user nova-compute[74540]:   <source dev="/dev/sdg"/>
Nov 07 04:18:11 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:18:11 user nova-compute[74540]:   <serial>73724c8e-8a48-472b-b102-56816e2f1526</serial>
Nov 07 04:18:11 user nova-compute[74540]: </disk>
Nov 07 04:18:11 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:18:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:18:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:18:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] No VIF found with MAC fa:16:3e:7d:d5:46, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:18:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-3613b98b-a416-4aea-998b-e45a8a938b51 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "3f430e2c-d045-48b8-8266-76b8096995f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.196s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:18:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "3f430e2c-d045-48b8-8266-76b8096995f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:18:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "3f430e2c-d045-48b8-8266-76b8096995f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:18:14 user nova-compute[74540]: INFO nova.compute.manager [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Detaching volume 73724c8e-8a48-472b-b102-56816e2f1526
Nov 07 04:18:14 user nova-compute[74540]: INFO nova.virt.block_device [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Attempting to driver detach volume 73724c8e-8a48-472b-b102-56816e2f1526 from mountpoint /dev/vdb
Nov 07 04:18:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Attempting to detach device vdb from instance 3f430e2c-d045-48b8-8266-76b8096995f0 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:18:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:18:14 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:18:14 user nova-compute[74540]:   <source dev="/dev/sdg"/>
Nov 07 04:18:14 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:18:14 user nova-compute[74540]:   <serial>73724c8e-8a48-472b-b102-56816e2f1526</serial>
Nov 07 04:18:14 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:18:14 user nova-compute[74540]: </disk>
Nov 07 04:18:14 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:18:14 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Successfully detached device vdb from instance 3f430e2c-d045-48b8-8266-76b8096995f0 from the persistent domain config.
Nov 07 04:18:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f430e2c-d045-48b8-8266-76b8096995f0 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:18:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:18:14 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:18:14 user nova-compute[74540]:   <source dev="/dev/sdg"/>
Nov 07 04:18:14 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:18:14 user nova-compute[74540]:   <serial>73724c8e-8a48-472b-b102-56816e2f1526</serial>
Nov 07 04:18:14 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:18:14 user nova-compute[74540]: </disk>
Nov 07 04:18:14 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:18:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f430e2c-d045-48b8-8266-76b8096995f0 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:18:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:18 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60104cc3-faf7-408c-8b95-7195ad105d3b is timed out.
Nov 07 04:18:18 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully detached device vdb from instance 60104cc3-faf7-408c-8b95-7195ad105d3b from the live domain config.
Nov 07 04:18:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQuESeWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:18:18 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[027e2180-9ddd-4c99-b17a-c8756f2a141a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:18:18 user nova-compute[74540]: No targets found.
Nov 07 04:18:18 user nova-compute[74540]: iSNS:
Nov 07 04:18:18 user nova-compute[74540]: No targets found.
Nov 07 04:18:18 user nova-compute[74540]: STATIC:
Nov 07 04:18:18 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719
Nov 07 04:18:18 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:18 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:18 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866
Nov 07 04:18:18 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:18 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:18 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526
Nov 07 04:18:18 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:18 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:18 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a
Nov 07 04:18:18 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:18 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:18 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1
Nov 07 04:18:18 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:18 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:18 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:18:18 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:18 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:18 user nova-compute[74540]: FIRMWARE:
Nov 07 04:18:18 user nova-compute[74540]: No targets found.
Nov 07 04:18:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:18:18 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:18:18 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[45918e07-c1e8-4f9f-9715-8ac304a55bd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27738e5-322a-4ed1-874b-c066a7867706]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:18 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:18 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:18:18 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:18 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:18:18 user nova-compute[74540]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 (non-flash)
Nov 07 04:18:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:18 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:18 user nova-compute[74540]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 (non-flash)
Nov 07 04:18:18 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:18 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:18:18 user nova-compute[74540]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 (non-flash)
Nov 07 04:18:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee1d52af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719'): ({'sdd'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Removing single pathed devices sdd {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0ad06d-78ef-4878-be6d-f380f617aa5c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2abb62a-0966-4f8c-aea4-a8546bcfac51]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Flushing IO for device /dev/sdd {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a8ce62-5280-413d-82ec-71b58ae35f7f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0725f81-4af2-4e29-b669-bc87e063f2b4]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.050s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef7fd12-8cc8-4ed7-9748-bf4e75922753]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0097ee6-3c85-4d8f-a518-d2bfe60b6a58]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719, portal: 172.16.0.220,3260]
Nov 07 04:18:18 user nova-compute[74540]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719, portal: 172.16.0.220,3260] successful.
Nov 07 04:18:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11489d3f-c8c8-4492-82d5-441eaa898719 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82591e8-396c-498e-8be4-3d910694a4b0]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] <== disconnect_volume: return (380ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:18:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:18:19 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 60104cc3-faf7-408c-8b95-7195ad105d3b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:18:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7832e24c-218b-414e-819f-33ff9ae17baf tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.982s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:18:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:18:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:18:20 user nova-compute[74540]: INFO nova.compute.manager [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Detaching volume 5f8e51a3-6ced-4baa-91ed-e5189e5af866
Nov 07 04:18:20 user nova-compute[74540]: INFO nova.virt.block_device [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Attempting to driver detach volume 5f8e51a3-6ced-4baa-91ed-e5189e5af866 from mountpoint /dev/vdc
Nov 07 04:18:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Attempting to detach device vdc from instance 60104cc3-faf7-408c-8b95-7195ad105d3b from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:18:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:18:20 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:18:20 user nova-compute[74540]:   <source dev="/dev/sde"/>
Nov 07 04:18:20 user nova-compute[74540]:   <target dev="vdc" bus="virtio"/>
Nov 07 04:18:20 user nova-compute[74540]:   <serial>5f8e51a3-6ced-4baa-91ed-e5189e5af866</serial>
Nov 07 04:18:20 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 07 04:18:20 user nova-compute[74540]: </disk>
Nov 07 04:18:20 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:18:20 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully detached device vdc from instance 60104cc3-faf7-408c-8b95-7195ad105d3b from the persistent domain config.
Nov 07 04:18:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 60104cc3-faf7-408c-8b95-7195ad105d3b from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:18:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:18:20 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:18:20 user nova-compute[74540]:   <source dev="/dev/sde"/>
Nov 07 04:18:20 user nova-compute[74540]:   <target dev="vdc" bus="virtio"/>
Nov 07 04:18:20 user nova-compute[74540]:   <serial>5f8e51a3-6ced-4baa-91ed-e5189e5af866</serial>
Nov 07 04:18:20 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 07 04:18:20 user nova-compute[74540]: </disk>
Nov 07 04:18:20 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:18:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 60104cc3-faf7-408c-8b95-7195ad105d3b {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:18:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:18:21 user nova-compute[74540]: INFO nova.compute.manager [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] instance snapshotting
Nov 07 04:18:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Beginning live snapshot process
Nov 07 04:18:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json -f qcow2 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json -f qcow2 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdvs5wquu/b8f947fe4d274f8c9c8031d8c923029d.delta 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdvs5wquu/b8f947fe4d274f8c9c8031d8c923029d.delta 1073741824" returned: 0 in 0.058s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:22 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 07 04:18:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:18:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:18:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74540) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 07 04:18:23 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 07 04:18:23 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:18:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdvs5wquu/b8f947fe4d274f8c9c8031d8c923029d.delta /opt/stack/data/nova/instances/snapshots/tmpdvs5wquu/b8f947fe4d274f8c9c8031d8c923029d {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdvs5wquu/b8f947fe4d274f8c9c8031d8c923029d.delta /opt/stack/data/nova/instances/snapshots/tmpdvs5wquu/b8f947fe4d274f8c9c8031d8c923029d" returned: 0 in 0.319s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:24 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Snapshot extracted, beginning image upload
Nov 07 04:18:26 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Snapshot image upload complete
Nov 07 04:18:26 user nova-compute[74540]: INFO nova.compute.manager [None req-b69f32e5-99fa-4c05-b71b-53863db3ebd2 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Took 5.30 seconds to snapshot the instance on the hypervisor.
Nov 07 04:18:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:18:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:18:35 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3f430e2c-d045-48b8-8266-76b8096995f0 is timed out.
Nov 07 04:18:35 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Successfully detached device vdb from instance 3f430e2c-d045-48b8-8266-76b8096995f0 from the live domain config.
Nov 07 04:18:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFIXPDCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:18:35 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cd06d2-766e-4ad6-b181-95e42c492507]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:18:35 user nova-compute[74540]: No targets found.
Nov 07 04:18:35 user nova-compute[74540]: iSNS:
Nov 07 04:18:35 user nova-compute[74540]: No targets found.
Nov 07 04:18:35 user nova-compute[74540]: STATIC:
Nov 07 04:18:35 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866
Nov 07 04:18:35 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:35 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:35 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526
Nov 07 04:18:35 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:35 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:35 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a
Nov 07 04:18:35 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:35 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:35 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1
Nov 07 04:18:35 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:35 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:35 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:18:35 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:35 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:35 user nova-compute[74540]: FIRMWARE:
Nov 07 04:18:35 user nova-compute[74540]: No targets found.
Nov 07 04:18:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:18:35 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:18:35 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe73b35-d398-403c-a928-c3f619e09f4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9370b80d-6171-4891-a408-0813e3bf9119]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:35 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:35 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:35 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:18:35 user nova-compute[74540]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 (non-flash)
Nov 07 04:18:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:35 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:35 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:35 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:18:35 user nova-compute[74540]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 (non-flash)
Nov 07 04:18:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc766a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526'): ({'sdg'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Removing single pathed devices sdg {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a14c1fe-31df-4e78-9e3f-28eeb6a37a7a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[67146a77-5e3a-4471-be05-e3408cf4c76b]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Flushing IO for device /dev/sdg {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c7d85f-3697-4b65-a36d-a9c8b10327e3]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.061s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa5ffd-75ed-4a9b-a246-eadbfc91a591]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] SCSI volumes sdg have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f1216b-e8d4-46ee-8968-5b15868cdd1e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3843ec4a-f903-41ea-9e7d-1f4baa920828]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526, portal: 172.16.0.220,3260]
Nov 07 04:18:35 user nova-compute[74540]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526, portal: 172.16.0.220,3260] successful.
Nov 07 04:18:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73724c8e-8a48-472b-b102-56816e2f1526 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5857f83-ff87-43dd-ac6a-d1db8db20f63]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] <== disconnect_volume: return (376ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:18:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:18:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:18:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:18:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:18:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:18:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:38 user nova-compute[74540]: DEBUG nova.objects.instance [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lazy-loading 'flavor' on Instance uuid 3f430e2c-d045-48b8-8266-76b8096995f0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:18:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-393cc54d-f664-487a-88c2-0ba68aba8474 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "3f430e2c-d045-48b8-8266-76b8096995f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.311s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:18:40 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:18:40 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:18:41 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 60104cc3-faf7-408c-8b95-7195ad105d3b is timed out.
Nov 07 04:18:41 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully detached device vdc from instance 60104cc3-faf7-408c-8b95-7195ad105d3b from the live domain config.
Nov 07 04:18:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPQRfMal', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:18:41 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7d1cd8-3d8c-43e5-98eb-c9e32544fb57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:18:41 user nova-compute[74540]: No targets found.
Nov 07 04:18:41 user nova-compute[74540]: iSNS:
Nov 07 04:18:41 user nova-compute[74540]: No targets found.
Nov 07 04:18:41 user nova-compute[74540]: STATIC:
Nov 07 04:18:41 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866
Nov 07 04:18:41 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:41 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:41 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a
Nov 07 04:18:41 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:41 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:41 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1
Nov 07 04:18:41 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:41 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:41 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:18:41 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:18:41 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:18:41 user nova-compute[74540]: FIRMWARE:
Nov 07 04:18:41 user nova-compute[74540]: No targets found.
Nov 07 04:18:41 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:18:41 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:18:41 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e771f1-53f1-4625-bc6e-332742f01cb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e757612e-6b3f-4cb5-8500-907df8db7104]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:41 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:41 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:41 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:18:41 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:18:41 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:18:41 user nova-compute[74540]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 (non-flash)
Nov 07 04:18:41 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:18:41 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc764550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866'): ({'sde'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Removing single pathed devices sde {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c96c75-e561-451d-a9da-8a3f82e77d54]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91c0dd6-afd8-4fa4-9c57-9d1f2a31a1da]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Flushing IO for device /dev/sde {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ff0644-7c68-4756-914b-169d6fedde33]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[544d712b-4a65-4190-99c7-e872de9c9727]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] SCSI volumes sde have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9370acba-4f73-4cd8-8fcf-dae2604cfff8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffb2386-6678-425f-999b-51296fa7e578]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866, portal: 172.16.0.220,3260]
Nov 07 04:18:41 user nova-compute[74540]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866, portal: 172.16.0.220,3260] successful.
Nov 07 04:18:41 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8e51a3-6ced-4baa-91ed-e5189e5af866 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed5108a-6ef4-4976-a185-9ef354023b11]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] <== disconnect_volume: return (335ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:18:41 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:18:42 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:18:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:18:45 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:18:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:18:46 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:18:47 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:18:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:18:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:18:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:18:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:18:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:18:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:49 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:18:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:18:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:18:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:18:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:18:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:18:50 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:18:50 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'flavor' on Instance uuid 60104cc3-faf7-408c-8b95-7195ad105d3b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:18:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f6e5c872-8c21-405d-b4bb-f81738eb1009 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.427s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:18:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:18:52 user nova-compute[74540]: INFO nova.compute.manager [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Terminating instance
Nov 07 04:18:52 user nova-compute[74540]: DEBUG nova.compute.manager [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-67e33ae1-a585-40f4-825c-1dc83cc3d78b req-50f6fd2f-5747-414a-8058-a6fddebbfd38 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Received event network-vif-unplugged-b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-67e33ae1-a585-40f4-825c-1dc83cc3d78b req-50f6fd2f-5747-414a-8058-a6fddebbfd38 service nova] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-67e33ae1-a585-40f4-825c-1dc83cc3d78b req-50f6fd2f-5747-414a-8058-a6fddebbfd38 service nova] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-67e33ae1-a585-40f4-825c-1dc83cc3d78b req-50f6fd2f-5747-414a-8058-a6fddebbfd38 service nova] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-67e33ae1-a585-40f4-825c-1dc83cc3d78b req-50f6fd2f-5747-414a-8058-a6fddebbfd38 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] No waiting events found dispatching network-vif-unplugged-b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-67e33ae1-a585-40f4-825c-1dc83cc3d78b req-50f6fd2f-5747-414a-8058-a6fddebbfd38 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Received event network-vif-unplugged-b3db2639-3be8-4213-88a7-7295fad36c80 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:52 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Instance destroyed successfully.
Nov 07 04:18:52 user nova-compute[74540]: DEBUG nova.objects.instance [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lazy-loading 'resources' on Instance uuid 60104cc3-faf7-408c-8b95-7195ad105d3b {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:14:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1371522689',display_name='tempest-AttachVolumeTestJSON-server-1371522689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1371522689',id=33,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtViIuNrGVxr8xa1CIVo8HTFs2rbXYriIfxRBM1I/0DTP/2zS2Iu04jvtOWjBJwP0VNJBn8BlqJQAY0TVtpVmRWwmSZp97yg80kjIGbXeMuabtCks8o/oK5CTLIM6qW8w==',key_name='tempest-keypair-729933638',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:15:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513e7858a1b34aa2bd5f363696b38f0a',ramdisk_id='',reservation_id='r-s1o5p2vn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-540287196',owner_user_name='tempest-AttachVolumeTestJSON-540287196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='791771e33e0645d6b97cef52f84d8b9c',uuid=60104cc3-faf7-408c-8b95-7195ad105d3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3db2639-3be8-4213-88a7-7295fad36c80", "address": "fa:16:3e:35:18:90", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3db2639-3b", "ovs_interfaceid": "b3db2639-3be8-4213-88a7-7295fad36c80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converting VIF {"id": "b3db2639-3be8-4213-88a7-7295fad36c80", "address": "fa:16:3e:35:18:90", "network": {"id": "ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-535016910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513e7858a1b34aa2bd5f363696b38f0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3db2639-3b", "ovs_interfaceid": "b3db2639-3be8-4213-88a7-7295fad36c80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:18:90,bridge_name='br-int',has_traffic_filtering=True,id=b3db2639-3be8-4213-88a7-7295fad36c80,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3db2639-3b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG os_vif [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:18:90,bridge_name='br-int',has_traffic_filtering=True,id=b3db2639-3be8-4213-88a7-7295fad36c80,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3db2639-3b') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3db2639-3b, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd2e9b28-41c3-4243-8618-255c83a738a9) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:18:52 user nova-compute[74540]: INFO os_vif [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:18:90,bridge_name='br-int',has_traffic_filtering=True,id=b3db2639-3be8-4213-88a7-7295fad36c80,network=Network(ee8c50c3-a21c-4d7f-8b8c-950eafb2d4fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3db2639-3b')
Nov 07 04:18:52 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Deleting instance files /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b_del
Nov 07 04:18:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Deletion of /opt/stack/data/nova/instances/60104cc3-faf7-408c-8b95-7195ad105d3b_del complete
Nov 07 04:18:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:53 user nova-compute[74540]: INFO nova.compute.manager [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 07 04:18:53 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:18:53 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:18:53 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:18:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:18:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:18:54 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Took 1.24 seconds to deallocate network for instance.
Nov 07 04:18:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-44c34520-cdfa-4f1d-84e6-4d6b5c22b726 req-341ea509-7a4f-4f95-921b-3834f5a3d654 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Received event network-vif-deleted-b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-e6d1543b-3bd3-4811-8af2-9fdb0ef67603 req-807ed20b-45d7-457a-9cc7-15ace8377f24 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Received event network-vif-plugged-b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e6d1543b-3bd3-4811-8af2-9fdb0ef67603 req-807ed20b-45d7-457a-9cc7-15ace8377f24 service nova] Acquiring lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e6d1543b-3bd3-4811-8af2-9fdb0ef67603 req-807ed20b-45d7-457a-9cc7-15ace8377f24 service nova] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e6d1543b-3bd3-4811-8af2-9fdb0ef67603 req-807ed20b-45d7-457a-9cc7-15ace8377f24 service nova] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-e6d1543b-3bd3-4811-8af2-9fdb0ef67603 req-807ed20b-45d7-457a-9cc7-15ace8377f24 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] No waiting events found dispatching network-vif-plugged-b3db2639-3be8-4213-88a7-7295fad36c80 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:18:54 user nova-compute[74540]: WARNING nova.compute.manager [req-e6d1543b-3bd3-4811-8af2-9fdb0ef67603 req-807ed20b-45d7-457a-9cc7-15ace8377f24 service nova] [instance: 60104cc3-faf7-408c-8b95-7195ad105d3b] Received unexpected event network-vif-plugged-b3db2639-3be8-4213-88a7-7295fad36c80 for instance with vm_state deleted and task_state None.
Nov 07 04:18:54 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:18:54 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.008s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:18:55 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:18:55 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=7551MB free_disk=24.632686614990234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:18:55 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Deleted allocations for instance 60104cc3-faf7-408c-8b95-7195ad105d3b
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance eab83056-14bd-4dd3-bcd0-7bc25cb8f722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bbed18c8-efc2-453e-825c-caf6a686c9cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 7f2a213c-40b8-4a93-a6ae-e363fbc03496 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 3f430e2c-d045-48b8-8266-76b8096995f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cf7282e9-e16c-46c0-87e0-cca5f3ff4785 tempest-AttachVolumeTestJSON-540287196 tempest-AttachVolumeTestJSON-540287196-project-member] Lock "60104cc3-faf7-408c-8b95-7195ad105d3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.612s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:18:55 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:18:56 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:18:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:18:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:00 user nova-compute[74540]: INFO nova.compute.manager [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Terminating instance
Nov 07 04:19:00 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:19:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG nova.compute.manager [req-4767cc7a-26d6-4c11-a026-021e3faf60c3 req-cf601a1c-107b-4955-be54-5c25885f09c9 service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Received event network-vif-unplugged-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4767cc7a-26d6-4c11-a026-021e3faf60c3 req-cf601a1c-107b-4955-be54-5c25885f09c9 service nova] Acquiring lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4767cc7a-26d6-4c11-a026-021e3faf60c3 req-cf601a1c-107b-4955-be54-5c25885f09c9 service nova] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4767cc7a-26d6-4c11-a026-021e3faf60c3 req-cf601a1c-107b-4955-be54-5c25885f09c9 service nova] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG nova.compute.manager [req-4767cc7a-26d6-4c11-a026-021e3faf60c3 req-cf601a1c-107b-4955-be54-5c25885f09c9 service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] No waiting events found dispatching network-vif-unplugged-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG nova.compute.manager [req-4767cc7a-26d6-4c11-a026-021e3faf60c3 req-cf601a1c-107b-4955-be54-5c25885f09c9 service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Received event network-vif-unplugged-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:01 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Instance destroyed successfully.
Nov 07 04:19:01 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lazy-loading 'resources' on Instance uuid 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:17:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1245162047',display_name='tempest-ServersNegativeTestJSON-server-1245162047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1245162047',id=38,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:17:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8c4c299b1b74a68a93a3f373067051f',ramdisk_id='',reservation_id='r-djarkpus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-640893805',owner_user_name='tempest-ServersNegativeTestJSON-640893805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:17:17Z,user_data=None,user_id='8b1fde560d4146e48532693afb044a41',uuid=7d0cce7c-b661-45d8-a197-6a8aa81c1b1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "address": "fa:16:3e:61:4f:d0", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2366a5f-65", "ovs_interfaceid": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Converting VIF {"id": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "address": "fa:16:3e:61:4f:d0", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2366a5f-65", "ovs_interfaceid": "e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:4f:d0,bridge_name='br-int',has_traffic_filtering=True,id=e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2366a5f-65') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG os_vif [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:4f:d0,bridge_name='br-int',has_traffic_filtering=True,id=e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2366a5f-65') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2366a5f-65, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6e486ea-c74f-4ff3-9f62-266e735e8410) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:01 user nova-compute[74540]: INFO os_vif [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:4f:d0,bridge_name='br-int',has_traffic_filtering=True,id=e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2366a5f-65')
Nov 07 04:19:01 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Deleting instance files /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f_del
Nov 07 04:19:01 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Deletion of /opt/stack/data/nova/instances/7d0cce7c-b661-45d8-a197-6a8aa81c1b1f_del complete
Nov 07 04:19:01 user nova-compute[74540]: INFO nova.compute.manager [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 07 04:19:01 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:19:01 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:19:02 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Took 0.64 seconds to deallocate network for instance.
Nov 07 04:19:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Updating instance_info_cache with network_info: [{"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:19:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:02 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Deleted allocations for instance 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f
Nov 07 04:19:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7e18f71-6825-4fd7-8408-fc17a212c055 tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.031s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:03 user nova-compute[74540]: DEBUG nova.compute.manager [req-d588ea76-b637-48f1-be45-e294737d8932 req-2a3807dc-94fa-44ea-b7ff-9d72a84526d1 service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Received event network-vif-plugged-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d588ea76-b637-48f1-be45-e294737d8932 req-2a3807dc-94fa-44ea-b7ff-9d72a84526d1 service nova] Acquiring lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d588ea76-b637-48f1-be45-e294737d8932 req-2a3807dc-94fa-44ea-b7ff-9d72a84526d1 service nova] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d588ea76-b637-48f1-be45-e294737d8932 req-2a3807dc-94fa-44ea-b7ff-9d72a84526d1 service nova] Lock "7d0cce7c-b661-45d8-a197-6a8aa81c1b1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:03 user nova-compute[74540]: DEBUG nova.compute.manager [req-d588ea76-b637-48f1-be45-e294737d8932 req-2a3807dc-94fa-44ea-b7ff-9d72a84526d1 service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] No waiting events found dispatching network-vif-plugged-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:19:03 user nova-compute[74540]: WARNING nova.compute.manager [req-d588ea76-b637-48f1-be45-e294737d8932 req-2a3807dc-94fa-44ea-b7ff-9d72a84526d1 service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Received unexpected event network-vif-plugged-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 for instance with vm_state deleted and task_state None.
Nov 07 04:19:03 user nova-compute[74540]: DEBUG nova.compute.manager [req-d588ea76-b637-48f1-be45-e294737d8932 req-2a3807dc-94fa-44ea-b7ff-9d72a84526d1 service nova] [instance: 7d0cce7c-b661-45d8-a197-6a8aa81c1b1f] Received event network-vif-deleted-e2366a5f-65e2-4342-8f02-e0f3f1c8aaf6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:04 user nova-compute[74540]: INFO nova.compute.manager [None req-05a9ba71-8060-44a4-b23c-a5ba60ceb5dc tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Get console output
Nov 07 04:19:04 user nova-compute[74540]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 07 04:19:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-826dba28-334c-4f85-8170-ea99cd45607d req-3b6516d0-2ade-42fa-8189-6c4fb8482eb9 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received event network-changed-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-826dba28-334c-4f85-8170-ea99cd45607d req-3b6516d0-2ade-42fa-8189-6c4fb8482eb9 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Refreshing instance network info cache due to event network-changed-3d22bce5-b4e4-433c-a8bf-e25013902730. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:19:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-826dba28-334c-4f85-8170-ea99cd45607d req-3b6516d0-2ade-42fa-8189-6c4fb8482eb9 service nova] Acquiring lock "refresh_cache-3f430e2c-d045-48b8-8266-76b8096995f0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:19:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-826dba28-334c-4f85-8170-ea99cd45607d req-3b6516d0-2ade-42fa-8189-6c4fb8482eb9 service nova] Acquired lock "refresh_cache-3f430e2c-d045-48b8-8266-76b8096995f0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:19:05 user nova-compute[74540]: DEBUG nova.network.neutron [req-826dba28-334c-4f85-8170-ea99cd45607d req-3b6516d0-2ade-42fa-8189-6c4fb8482eb9 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Refreshing network info cache for port 3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:19:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "3f430e2c-d045-48b8-8266-76b8096995f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "3f430e2c-d045-48b8-8266-76b8096995f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:05 user nova-compute[74540]: INFO nova.compute.manager [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Terminating instance
Nov 07 04:19:05 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:19:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG nova.network.neutron [req-826dba28-334c-4f85-8170-ea99cd45607d req-3b6516d0-2ade-42fa-8189-6c4fb8482eb9 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Updated VIF entry in instance network info cache for port 3d22bce5-b4e4-433c-a8bf-e25013902730. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG nova.network.neutron [req-826dba28-334c-4f85-8170-ea99cd45607d req-3b6516d0-2ade-42fa-8189-6c4fb8482eb9 service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Updating instance_info_cache with network_info: [{"id": "3d22bce5-b4e4-433c-a8bf-e25013902730", "address": "fa:16:3e:7d:d5:46", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d22bce5-b4", "ovs_interfaceid": "3d22bce5-b4e4-433c-a8bf-e25013902730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-826dba28-334c-4f85-8170-ea99cd45607d req-3b6516d0-2ade-42fa-8189-6c4fb8482eb9 service nova] Releasing lock "refresh_cache-3f430e2c-d045-48b8-8266-76b8096995f0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Instance destroyed successfully.
Nov 07 04:19:06 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lazy-loading 'resources' on Instance uuid 3f430e2c-d045-48b8-8266-76b8096995f0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2025278445',display_name='tempest-TestStampPattern-server-2025278445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2025278445',id=36,image_ref='aa764985-a13a-4f29-b6e0-0615762ac871',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoMfE2Q8gNUKNl0nmrHkjFV2OAeuMJzS+ql/IUfGPF1eNzZ6Aqxy5NrG9xZoAUwwIFWT3HNiNLxHgs0GzsPBY0ju025YOE6ZmiTIQk/+eBuGfERE2Lyjk3Ye8OTrYx9mA==',key_name='tempest-TestStampPattern-1539418775',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:16:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29f9a52c6a1044b8bc854c8a86d81827',ramdisk_id='',reservation_id='r-axtxacr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='cc15c8fc-e47f-4df0-94ec-8daeacb112c9',image_min_disk='1',image_min_ram='0',image_owner_id='29f9a52c6a1044b8bc854c8a86d81827',image_owner_project_name='tempest-TestStampPattern-310684050',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-310684050-project-member',image_user_id='3580d0b365fa4f2f8599747d474e8c7e',owner_project_name='tempest-TestStampPattern-310684050',owner_user_name='tempest-TestStampPattern-310684050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:16:02Z,user_data=None,user_id='3580d0b365fa4f2f8599747d474e8c7e',uuid=3f430e2c-d045-48b8-8266-76b8096995f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d22bce5-b4e4-433c-a8bf-e25013902730", "address": "fa:16:3e:7d:d5:46", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d22bce5-b4", "ovs_interfaceid": "3d22bce5-b4e4-433c-a8bf-e25013902730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Converting VIF {"id": "3d22bce5-b4e4-433c-a8bf-e25013902730", "address": "fa:16:3e:7d:d5:46", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d22bce5-b4", "ovs_interfaceid": "3d22bce5-b4e4-433c-a8bf-e25013902730", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d5:46,bridge_name='br-int',has_traffic_filtering=True,id=3d22bce5-b4e4-433c-a8bf-e25013902730,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d22bce5-b4') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG os_vif [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d5:46,bridge_name='br-int',has_traffic_filtering=True,id=3d22bce5-b4e4-433c-a8bf-e25013902730,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d22bce5-b4') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d22bce5-b4, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=075de772-3cc9-4cbd-83d8-28e1b30c521c) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: INFO os_vif [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d5:46,bridge_name='br-int',has_traffic_filtering=True,id=3d22bce5-b4e4-433c-a8bf-e25013902730,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d22bce5-b4')
Nov 07 04:19:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Deleting instance files /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0_del
Nov 07 04:19:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Deletion of /opt/stack/data/nova/instances/3f430e2c-d045-48b8-8266-76b8096995f0_del complete
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:06 user nova-compute[74540]: INFO nova.compute.manager [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 07 04:19:06 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:19:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:19:07 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Took 0.79 seconds to deallocate network for instance.
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received event network-vif-unplugged-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] Acquiring lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] No waiting events found dispatching network-vif-unplugged-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:19:07 user nova-compute[74540]: WARNING nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received unexpected event network-vif-unplugged-3d22bce5-b4e4-433c-a8bf-e25013902730 for instance with vm_state deleted and task_state None.
Nov 07 04:19:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received event network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] Acquiring lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] No waiting events found dispatching network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:19:07 user nova-compute[74540]: WARNING nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received unexpected event network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 for instance with vm_state deleted and task_state None.
Nov 07 04:19:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received event network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] Acquiring lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] No waiting events found dispatching network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:19:07 user nova-compute[74540]: WARNING nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received unexpected event network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 for instance with vm_state deleted and task_state None.
Nov 07 04:19:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received event network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] Acquiring lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] Lock "3f430e2c-d045-48b8-8266-76b8096995f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] No waiting events found dispatching network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:19:07 user nova-compute[74540]: WARNING nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received unexpected event network-vif-plugged-3d22bce5-b4e4-433c-a8bf-e25013902730 for instance with vm_state deleted and task_state None.
Nov 07 04:19:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-24efdf69-5cd3-4826-a98c-36854b5925ea req-99c89785-ae20-482a-a6cc-fb47f866439c service nova] [instance: 3f430e2c-d045-48b8-8266-76b8096995f0] Received event network-vif-deleted-3d22bce5-b4e4-433c-a8bf-e25013902730 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:07 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Deleted allocations for instance 3f430e2c-d045-48b8-8266-76b8096995f0
Nov 07 04:19:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f5f16e0-75ec-4e38-a79e-29e75fa880b0 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "3f430e2c-d045-48b8-8266-76b8096995f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.263s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:08 user nova-compute[74540]: INFO nova.compute.manager [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Detaching volume d84bd96d-3cf4-4be0-9e25-1fd6aa58961a
Nov 07 04:19:08 user nova-compute[74540]: INFO nova.virt.block_device [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Attempting to driver detach volume d84bd96d-3cf4-4be0-9e25-1fd6aa58961a from mountpoint /dev/vdb
Nov 07 04:19:08 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Attempting to detach device vdb from instance 7f2a213c-40b8-4a93-a6ae-e363fbc03496 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:19:08 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:19:08 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:19:08 user nova-compute[74540]:   <source dev="/dev/sdf"/>
Nov 07 04:19:08 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:19:08 user nova-compute[74540]:   <serial>d84bd96d-3cf4-4be0-9e25-1fd6aa58961a</serial>
Nov 07 04:19:08 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:19:08 user nova-compute[74540]: </disk>
Nov 07 04:19:08 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:19:08 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Successfully detached device vdb from instance 7f2a213c-40b8-4a93-a6ae-e363fbc03496 from the persistent domain config.
Nov 07 04:19:08 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f2a213c-40b8-4a93-a6ae-e363fbc03496 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:19:08 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:19:08 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:19:08 user nova-compute[74540]:   <source dev="/dev/sdf"/>
Nov 07 04:19:08 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:19:08 user nova-compute[74540]:   <serial>d84bd96d-3cf4-4be0-9e25-1fd6aa58961a</serial>
Nov 07 04:19:08 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:19:08 user nova-compute[74540]: </disk>
Nov 07 04:19:08 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:19:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:08 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f2a213c-40b8-4a93-a6ae-e363fbc03496 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:19:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:19:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:19:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:28 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7f2a213c-40b8-4a93-a6ae-e363fbc03496 is timed out.
Nov 07 04:19:28 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Successfully detached device vdb from instance 7f2a213c-40b8-4a93-a6ae-e363fbc03496 from the live domain config.
Nov 07 04:19:28 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:19:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIelaLoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:19:28 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:19:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:19:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:19:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5fc36b-9f8f-4b3b-8c02-622995c57d1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:19:28 user nova-compute[74540]: No targets found.
Nov 07 04:19:28 user nova-compute[74540]: iSNS:
Nov 07 04:19:28 user nova-compute[74540]: No targets found.
Nov 07 04:19:28 user nova-compute[74540]: STATIC:
Nov 07 04:19:28 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a
Nov 07 04:19:28 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:19:28 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:19:28 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1
Nov 07 04:19:28 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:19:28 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:19:28 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:19:28 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:19:28 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:19:28 user nova-compute[74540]: FIRMWARE:
Nov 07 04:19:28 user nova-compute[74540]: No targets found.
Nov 07 04:19:28 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:19:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:19:28 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:19:28 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:19:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:19:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e78c835-ed74-4c37-aef8-bf7e3ba6e117]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce8dfbb-bf80-497b-baf2-3512bfca3862]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:19:29 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:19:29 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:19:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:19:29 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:19:29 user nova-compute[74540]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a (non-flash)
Nov 07 04:19:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc39f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a'): ({'sdf'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Removing single pathed devices sdf {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e584a075-bebb-4ba2-ace4-0b3f1a8f5ead]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c75688-1182-4114-a73c-8bfd35c56574]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Flushing IO for device /dev/sdf {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cd79d1-7a06-4dc1-b0f1-737373cf9c30]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:19:29 user nova-compute[74540]: INFO nova.compute.claims [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Claim successful on node user
Nov 07 04:19:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b72086-c4bc-43fc-aa43-7f532d3ac026]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] SCSI volumes sdf have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[de39a5a8-3c57-47ab-b41e-636f7ac84999]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bb1b3f-3766-46c8-8ecf-fdc1483f6e5a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a, portal: 172.16.0.220,3260]
Nov 07 04:19:29 user nova-compute[74540]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a, portal: 172.16.0.220,3260] successful.
Nov 07 04:19:29 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[89126874-a69b-4a80-a620-f23e3f2e8576]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] <== disconnect_volume: return (349ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:19:29 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:19:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:19:29 user nova-compute[74540]: DEBUG nova.policy [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99ba0f9acca84cdb8cf90c4b313e1b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438cd05cbdb34608940422562ba150c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:19:29 user nova-compute[74540]: INFO nova.virt.block_device [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Booting with volume-backed-image b2fc4ee2-830c-4852-b2e5-8dcdd33e1718 at /dev/vda
Nov 07 04:19:30 user nova-compute[74540]: DEBUG nova.objects.instance [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lazy-loading 'flavor' on Instance uuid 7f2a213c-40b8-4a93-a6ae-e363fbc03496 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-85f357a2-ce24-4fc4-ad7d-8f6fd2a6691c tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.063s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.915s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:30 user nova-compute[74540]: INFO nova.compute.manager [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Terminating instance
Nov 07 04:19:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Successfully created port: 5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-dac15cee-40b4-428e-a022-f8053aec3699 req-cd58c65b-81e4-4f26-bfbc-82a0bb847631 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Received event network-vif-unplugged-75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dac15cee-40b4-428e-a022-f8053aec3699 req-cd58c65b-81e4-4f26-bfbc-82a0bb847631 service nova] Acquiring lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dac15cee-40b4-428e-a022-f8053aec3699 req-cd58c65b-81e4-4f26-bfbc-82a0bb847631 service nova] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dac15cee-40b4-428e-a022-f8053aec3699 req-cd58c65b-81e4-4f26-bfbc-82a0bb847631 service nova] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-dac15cee-40b4-428e-a022-f8053aec3699 req-cd58c65b-81e4-4f26-bfbc-82a0bb847631 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] No waiting events found dispatching network-vif-unplugged-75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:19:30 user nova-compute[74540]: DEBUG nova.compute.manager [req-dac15cee-40b4-428e-a022-f8053aec3699 req-cd58c65b-81e4-4f26-bfbc-82a0bb847631 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Received event network-vif-unplugged-75a1d34f-2b29-46d6-a97c-107793dfb129 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:19:31 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Instance destroyed successfully.
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.objects.instance [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lazy-loading 'resources' on Instance uuid 7f2a213c-40b8-4a93-a6ae-e363fbc03496 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:15:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1344129285',display_name='tempest-VolumesSnapshotTestJSON-instance-1344129285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1344129285',id=35,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbA5zI7pOfP8FOtjPOQTwg140WhEFPNnACKTPYfMvcyxMl4kOF0tUBmaeH2JdCtjD6qr2b79ifk2jz8CQzyA7jRM+kAu03PE+Z+758YfM3r3w1K2PBdRpVpOeQqKuLckg==',key_name='tempest-keypair-737541603',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b682de4430634d9c88abd728196079a0',ramdisk_id='',reservation_id='r-p6kyfls4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1818707028',owner_user_name='tempest-VolumesSnapshotTestJSON-1818707028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88c598b2585a41829af42b129ccb51fa',uuid=7f2a213c-40b8-4a93-a6ae-e363fbc03496,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75a1d34f-2b29-46d6-a97c-107793dfb129", "address": "fa:16:3e:e5:4e:85", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a1d34f-2b", "ovs_interfaceid": "75a1d34f-2b29-46d6-a97c-107793dfb129", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Converting VIF {"id": "75a1d34f-2b29-46d6-a97c-107793dfb129", "address": "fa:16:3e:e5:4e:85", "network": {"id": "f862c74e-a991-4700-a3f9-bdf318416bbf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-899701763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b682de4430634d9c88abd728196079a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a1d34f-2b", "ovs_interfaceid": "75a1d34f-2b29-46d6-a97c-107793dfb129", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:4e:85,bridge_name='br-int',has_traffic_filtering=True,id=75a1d34f-2b29-46d6-a97c-107793dfb129,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a1d34f-2b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_vif [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:4e:85,bridge_name='br-int',has_traffic_filtering=True,id=75a1d34f-2b29-46d6-a97c-107793dfb129,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a1d34f-2b') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75a1d34f-2b, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12fd7c81-927f-4575-b212-3ee3919783a6) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:31 user nova-compute[74540]: INFO os_vif [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:4e:85,bridge_name='br-int',has_traffic_filtering=True,id=75a1d34f-2b29-46d6-a97c-107793dfb129,network=Network(f862c74e-a991-4700-a3f9-bdf318416bbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a1d34f-2b')
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIelaLoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:19:31 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3314ea2d-d2e1-40d1-bc1a-60a3a2f4b53e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:19:31 user nova-compute[74540]: No targets found.
Nov 07 04:19:31 user nova-compute[74540]: iSNS:
Nov 07 04:19:31 user nova-compute[74540]: No targets found.
Nov 07 04:19:31 user nova-compute[74540]: STATIC:
Nov 07 04:19:31 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1
Nov 07 04:19:31 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:19:31 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:19:31 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:19:31 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:19:31 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:19:31 user nova-compute[74540]: FIRMWARE:
Nov 07 04:19:31 user nova-compute[74540]: No targets found.
Nov 07 04:19:31 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:19:31 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:19:31 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d84bd96d-3cf4-4be0-9e25-1fd6aa58961a', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f76bd3-47e5-4fa0-9d69-8604590fb824]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[73119679-6268-4c7b-9f86-07cf5f67d7c9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:19:31 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:19:31 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:19:31 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:19:31 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc7da5f0>, {}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Disconnecting from: [] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] <== disconnect_volume: return (90ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:19:31 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Deleting instance files /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496_del
Nov 07 04:19:31 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Deletion of /opt/stack/data/nova/instances/7f2a213c-40b8-4a93-a6ae-e363fbc03496_del complete
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Successfully updated port: 5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-c68f9d65-509c-4395-ab4c-bd36b34e5901 req-69a2e443-be87-424c-8bfd-02ce0c83d0ea service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-changed-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-c68f9d65-509c-4395-ab4c-bd36b34e5901 req-69a2e443-be87-424c-8bfd-02ce0c83d0ea service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Refreshing instance network info cache due to event network-changed-5a551def-df79-49de-a5ce-f6dea568e6c8. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c68f9d65-509c-4395-ab4c-bd36b34e5901 req-69a2e443-be87-424c-8bfd-02ce0c83d0ea service nova] Acquiring lock "refresh_cache-cfdde86e-1e12-44f3-88d1-ca15a66e03e8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c68f9d65-509c-4395-ab4c-bd36b34e5901 req-69a2e443-be87-424c-8bfd-02ce0c83d0ea service nova] Acquired lock "refresh_cache-cfdde86e-1e12-44f3-88d1-ca15a66e03e8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.network.neutron [req-c68f9d65-509c-4395-ab4c-bd36b34e5901 req-69a2e443-be87-424c-8bfd-02ce0c83d0ea service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Refreshing network info cache for port 5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "refresh_cache-cfdde86e-1e12-44f3-88d1-ca15a66e03e8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:19:31 user nova-compute[74540]: INFO nova.compute.manager [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.network.neutron [req-c68f9d65-509c-4395-ab4c-bd36b34e5901 req-69a2e443-be87-424c-8bfd-02ce0c83d0ea service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.network.neutron [req-c68f9d65-509c-4395-ab4c-bd36b34e5901 req-69a2e443-be87-424c-8bfd-02ce0c83d0ea service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c68f9d65-509c-4395-ab4c-bd36b34e5901 req-69a2e443-be87-424c-8bfd-02ce0c83d0ea service nova] Releasing lock "refresh_cache-cfdde86e-1e12-44f3-88d1-ca15a66e03e8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquired lock "refresh_cache-cfdde86e-1e12-44f3-88d1-ca15a66e03e8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:19:31 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Updating instance_info_cache with network_info: [{"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Releasing lock "refresh_cache-cfdde86e-1e12-44f3-88d1-ca15a66e03e8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Instance network_info: |[{"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:19:32 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Took 0.83 seconds to deallocate network for instance.
Nov 07 04:19:32 user nova-compute[74540]: WARNING nova.volume.cinder [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Attachment 8d044632-d3ac-4a43-9957-ad94d3a844e2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8d044632-d3ac-4a43-9957-ad94d3a844e2. (HTTP 404) (Request-ID: req-ca92befd-0c56-4a81-b069-45817f178f1f)
Nov 07 04:19:32 user nova-compute[74540]: INFO nova.compute.manager [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Took 0.04 seconds to detach 1 volumes for instance.
Nov 07 04:19:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:32 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Deleted allocations for instance 7f2a213c-40b8-4a93-a6ae-e363fbc03496
Nov 07 04:19:32 user nova-compute[74540]: DEBUG nova.compute.manager [req-0cb62dfd-6b46-498c-9276-6b60f6a76fd0 req-cbabefab-da10-4eb4-b882-0b0eb6295bf4 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Received event network-vif-plugged-75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0cb62dfd-6b46-498c-9276-6b60f6a76fd0 req-cbabefab-da10-4eb4-b882-0b0eb6295bf4 service nova] Acquiring lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0cb62dfd-6b46-498c-9276-6b60f6a76fd0 req-cbabefab-da10-4eb4-b882-0b0eb6295bf4 service nova] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0cb62dfd-6b46-498c-9276-6b60f6a76fd0 req-cbabefab-da10-4eb4-b882-0b0eb6295bf4 service nova] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG nova.compute.manager [req-0cb62dfd-6b46-498c-9276-6b60f6a76fd0 req-cbabefab-da10-4eb4-b882-0b0eb6295bf4 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] No waiting events found dispatching network-vif-plugged-75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:19:32 user nova-compute[74540]: WARNING nova.compute.manager [req-0cb62dfd-6b46-498c-9276-6b60f6a76fd0 req-cbabefab-da10-4eb4-b882-0b0eb6295bf4 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Received unexpected event network-vif-plugged-75a1d34f-2b29-46d6-a97c-107793dfb129 for instance with vm_state deleted and task_state None.
Nov 07 04:19:32 user nova-compute[74540]: DEBUG nova.compute.manager [req-0cb62dfd-6b46-498c-9276-6b60f6a76fd0 req-cbabefab-da10-4eb4-b882-0b0eb6295bf4 service nova] [instance: 7f2a213c-40b8-4a93-a6ae-e363fbc03496] Received event network-vif-deleted-75a1d34f-2b29-46d6-a97c-107793dfb129 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:19:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0d4690ad-06bb-4925-a5bb-f4f82c937f14 tempest-VolumesSnapshotTestJSON-1818707028 tempest-VolumesSnapshotTestJSON-1818707028-project-member] Lock "7f2a213c-40b8-4a93-a6ae-e363fbc03496" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.474s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:19:42 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:19:43 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:19:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:19:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:19:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:19:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:19:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:47 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:19:47 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:19:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:19:48 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG os_brick.utils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b4052e-ae8b-4656-9319-dd7535d0380b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[540e5327-fe1d-4cde-87f4-3733b6a97d89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cd9f46-2d3e-4001-971e-1b2e9164f5c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53a69b1-fd04-46da-bf8c-6a762c9e9fbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:19:50 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:19:50 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[04623ef6-bdc9-4908-b808-125fe34a0284]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG os_brick.utils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:19:50 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Updating existing volume attachment record: 621ddc66-be2c-46a7-a4b4-cb2b607409e4 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:19:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:51 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:19:51 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:19:52 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:19:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:19:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:19:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:19:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:19:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:19:55 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:19:55 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:19:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8196MB free_disk=24.705211639404297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance eab83056-14bd-4dd3-bcd0-7bc25cb8f722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bbed18c8-efc2-453e-825c-caf6a686c9cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cfdde86e-1e12-44f3-88d1-ca15a66e03e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:19:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:19:56 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:19:56 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:19:56 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:19:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:19:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:20:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:20:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:20:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:20:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:20:02 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:20:02 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Updating instance_info_cache with network_info: [{"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:20:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:20:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:05 user nova-compute[74540]: INFO nova.compute.manager [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Terminating instance
Nov 07 04:20:05 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-0c20e0b1-2383-409a-983f-20d26bb629f6 req-73cb83a2-1b26-4cd0-8053-3cca4c171051 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received event network-vif-unplugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0c20e0b1-2383-409a-983f-20d26bb629f6 req-73cb83a2-1b26-4cd0-8053-3cca4c171051 service nova] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0c20e0b1-2383-409a-983f-20d26bb629f6 req-73cb83a2-1b26-4cd0-8053-3cca4c171051 service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0c20e0b1-2383-409a-983f-20d26bb629f6 req-73cb83a2-1b26-4cd0-8053-3cca4c171051 service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-0c20e0b1-2383-409a-983f-20d26bb629f6 req-73cb83a2-1b26-4cd0-8053-3cca4c171051 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] No waiting events found dispatching network-vif-unplugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-0c20e0b1-2383-409a-983f-20d26bb629f6 req-73cb83a2-1b26-4cd0-8053-3cca4c171051 service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received event network-vif-unplugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:05 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Instance destroyed successfully.
Nov 07 04:20:05 user nova-compute[74540]: DEBUG nova.objects.instance [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lazy-loading 'resources' on Instance uuid bbed18c8-efc2-453e-825c-caf6a686c9cb {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:13:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-209729649',display_name='tempest-ServerActionsTestOtherA-server-209729649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-209729649',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwNZBrKGScuWsQUPfoY0b3AbxyGKSkLExG0cpMUZnRvSTxBRcsFtIZ1RT1pR1+eCQdUJD5DJCUo9GsJbQ2Fmr9SGNPRCHO5qhdeLD9soxcgYrMJdlf2ABhS3l6lT6tLnQ==',key_name='tempest-keypair-987204751',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-ovt0rkj3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:17:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=bbed18c8-efc2-453e-825c-caf6a686c9cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "address": "fa:16:3e:5d:2b:e9", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d45ca-93", "ovs_interfaceid": "9a1d45ca-93e6-4b48-a819-06ae409b7c89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG os_vif [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:20:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a1d45ca-93, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c573d26-586e-4858-9d46-2b5d4dc26de2) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:20:06 user nova-compute[74540]: INFO os_vif [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2b:e9,bridge_name='br-int',has_traffic_filtering=True,id=9a1d45ca-93e6-4b48-a819-06ae409b7c89,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d45ca-93')
Nov 07 04:20:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNIMceKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:20:06 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a947e11b-4392-4f35-a8f0-8a67422c9337]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:20:06 user nova-compute[74540]: No targets found.
Nov 07 04:20:06 user nova-compute[74540]: iSNS:
Nov 07 04:20:06 user nova-compute[74540]: No targets found.
Nov 07 04:20:06 user nova-compute[74540]: STATIC:
Nov 07 04:20:06 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1
Nov 07 04:20:06 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:20:06 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:20:06 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:20:06 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:20:06 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:20:06 user nova-compute[74540]: FIRMWARE:
Nov 07 04:20:06 user nova-compute[74540]: No targets found.
Nov 07 04:20:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:20:06 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:20:06 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2534e10a-b26b-4a61-b357-37aebc7cf912]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b84843-a92a-4d0f-8b1c-184c62d6a7f1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:20:06 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:20:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:20:06 user nova-compute[74540]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 (non-flash)
Nov 07 04:20:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc23bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[66155d0b-c586-49f0-ac0e-54dc41ec5edc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5e5dd0-bf0a-4767-bb55-25e28d434bbe]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82d7bc1-bddb-4112-9d0b-0c0be63b81eb]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dfb090-9ba0-46d6-8520-a82fc6beeacf]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4803392d', '/dev/disk/by-id/scsi-1SCST_BIO4803392d-7c9f3f4883475ddf', '/dev/disk/by-id/scsi-23763396633663438') {{(pid=85868) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4910bff-c6fd-43f5-aa65-3d77cf375e61]: (4, None) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[25afeda4-867f-461e-81f4-09b298068c37]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b932f2-c395-4a2b-92f7-a54efc651577]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260]
Nov 07 04:20:06 user nova-compute[74540]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1, portal: 172.16.0.220,3260] successful.
Nov 07 04:20:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4152bc01-2e45-4a4a-898e-67ca9253d5d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77160d6-4ab1-4c7c-9311-4f20eca9ee79]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] <== disconnect_volume: return (339ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:20:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Deleting instance files /opt/stack/data/nova/instances/bbed18c8-efc2-453e-825c-caf6a686c9cb_del
Nov 07 04:20:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Deletion of /opt/stack/data/nova/instances/bbed18c8-efc2-453e-825c-caf6a686c9cb_del complete
Nov 07 04:20:06 user nova-compute[74540]: INFO nova.compute.manager [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 07 04:20:06 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:20:06 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:20:07 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:20:07 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Took 0.85 seconds to deallocate network for instance.
Nov 07 04:20:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-db783504-76a1-444a-827a-06a6e654baf0 req-1544bd32-9249-4ec5-a10b-41a50fcc08ad service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received event network-vif-deleted-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:20:07 user nova-compute[74540]: INFO nova.compute.manager [req-db783504-76a1-444a-827a-06a6e654baf0 req-1544bd32-9249-4ec5-a10b-41a50fcc08ad service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Neutron deleted interface 9a1d45ca-93e6-4b48-a819-06ae409b7c89; detaching it from the instance and deleting it from the info cache
Nov 07 04:20:07 user nova-compute[74540]: DEBUG nova.network.neutron [req-db783504-76a1-444a-827a-06a6e654baf0 req-1544bd32-9249-4ec5-a10b-41a50fcc08ad service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:20:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-db783504-76a1-444a-827a-06a6e654baf0 req-1544bd32-9249-4ec5-a10b-41a50fcc08ad service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Detach interface failed, port_id=9a1d45ca-93e6-4b48-a819-06ae409b7c89, reason: Instance bbed18c8-efc2-453e-825c-caf6a686c9cb could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:20:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-529ef901-1fd2-4eab-a514-cb712384848a req-690b2962-3082-4459-bab8-d5bc3e98cc8f service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received event network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:20:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-529ef901-1fd2-4eab-a514-cb712384848a req-690b2962-3082-4459-bab8-d5bc3e98cc8f service nova] Acquiring lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-529ef901-1fd2-4eab-a514-cb712384848a req-690b2962-3082-4459-bab8-d5bc3e98cc8f service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-529ef901-1fd2-4eab-a514-cb712384848a req-690b2962-3082-4459-bab8-d5bc3e98cc8f service nova] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-529ef901-1fd2-4eab-a514-cb712384848a req-690b2962-3082-4459-bab8-d5bc3e98cc8f service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] No waiting events found dispatching network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:20:07 user nova-compute[74540]: WARNING nova.compute.manager [req-529ef901-1fd2-4eab-a514-cb712384848a req-690b2962-3082-4459-bab8-d5bc3e98cc8f service nova] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Received unexpected event network-vif-plugged-9a1d45ca-93e6-4b48-a819-06ae409b7c89 for instance with vm_state active and task_state deleting.
Nov 07 04:20:08 user nova-compute[74540]: INFO nova.compute.manager [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Took 1.08 seconds to detach 1 volumes for instance.
Nov 07 04:20:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: bbed18c8-efc2-453e-825c-caf6a686c9cb] Deleting volume: 4152bc01-2e45-4a4a-898e-67ca9253d5d1 {{(pid=74540) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 07 04:20:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:08 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:20:08 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:20:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:08 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Deleted allocations for instance bbed18c8-efc2-453e-825c-caf6a686c9cb
Nov 07 04:20:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a92804ec-b851-4e61-aeb9-90185a3ae62b tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "bbed18c8-efc2-453e-825c-caf6a686c9cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.867s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:20:16 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Creating image(s)
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Ensure instance console log exists: /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Start _get_guest_xml network_info=[{"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIZCrXMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cfdde86e-1e12-44f3-88d1-ca15a66e03e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948', 'serial': 'fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948'}, 'boot_index': 0, 'attachment_id': '621ddc66-be2c-46a7-a4b4-cb2b607409e4', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:20:16 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:20:16 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIZCrXMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:20:16 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:20:16 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:20:16 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dbbbd3-0945-4b0e-8927-af0e13153c9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:20:16 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5c08d8-8d40-4f6e-860c-042779bdf712]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948] added
Nov 07 04:20:16 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbdd387-23fa-4afa-8bc9-746a218bcd70]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d138737-84d1-4b1e-ba65-c066278bdedc]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIZCrXMg {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIZCrXMg" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d595f4-d4d1-4cc1-9602-bafb9c310faa]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yIZCrXMg'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[084cd4f7-ecfa-45c8-a450-7d31c5fad0d4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f918ab7f-e11f-477b-bd54-6f8e572920e8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:20:16 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:20:16 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf67e1f1-81d8-4422-8962-6c7c5960b91e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948, portal: 172.16.0.220,3260]
Nov 07 04:20:16 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948, portal: 172.16.0.220,3260] successful.
Nov 07 04:20:16 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a373bdfd-f41d-46ea-bed0-e6c394f1345e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5163211c-5387-402b-963c-c9cf5b8c352b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:20:16 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:20:16 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:20:16 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:20:16 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a602bf7c-769c-42e0-ad2d-a1f65c5b16df]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:20:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIZCrXMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23730343230373461', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730343230373461', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-983957758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-983957758',id=39,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-2vfsbnzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:19:30Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=cfdde86e-1e12-44f3-88d1-ca15a66e03e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6c:b2,bridge_name='br-int',has_traffic_filtering=True,id=5a551def-df79-49de-a5ce-f6dea568e6c8,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a551def-df') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'pci_devices' on Instance uuid cfdde86e-1e12-44f3-88d1-ca15a66e03e8 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:20:17 user nova-compute[74540]:   <uuid>cfdde86e-1e12-44f3-88d1-ca15a66e03e8</uuid>
Nov 07 04:20:17 user nova-compute[74540]:   <name>instance-00000027</name>
Nov 07 04:20:17 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:20:17 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:20:17 user nova-compute[74540]:   <metadata>
Nov 07 04:20:17 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:20:17 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:20:17 user nova-compute[74540]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-983957758</nova:name>
Nov 07 04:20:17 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:20:16</nova:creationTime>
Nov 07 04:20:17 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:20:17 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:20:17 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:20:17 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:20:17 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:20:17 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:20:17 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:20:17 user nova-compute[74540]:       <nova:owner>
Nov 07 04:20:17 user nova-compute[74540]:         <nova:user uuid="99ba0f9acca84cdb8cf90c4b313e1b7c">tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member</nova:user>
Nov 07 04:20:17 user nova-compute[74540]:         <nova:project uuid="438cd05cbdb34608940422562ba150c8">tempest-ServerBootFromVolumeStableRescueTest-1329597446</nova:project>
Nov 07 04:20:17 user nova-compute[74540]:       </nova:owner>
Nov 07 04:20:17 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:20:17 user nova-compute[74540]:       <nova:ports>
Nov 07 04:20:17 user nova-compute[74540]:         <nova:port uuid="5a551def-df79-49de-a5ce-f6dea568e6c8">
Nov 07 04:20:17 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 07 04:20:17 user nova-compute[74540]:         </nova:port>
Nov 07 04:20:17 user nova-compute[74540]:       </nova:ports>
Nov 07 04:20:17 user nova-compute[74540]:     </nova:instance>
Nov 07 04:20:17 user nova-compute[74540]:   </metadata>
Nov 07 04:20:17 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:20:17 user nova-compute[74540]:     <system>
Nov 07 04:20:17 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:20:17 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:20:17 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:20:17 user nova-compute[74540]:       <entry name="serial">cfdde86e-1e12-44f3-88d1-ca15a66e03e8</entry>
Nov 07 04:20:17 user nova-compute[74540]:       <entry name="uuid">cfdde86e-1e12-44f3-88d1-ca15a66e03e8</entry>
Nov 07 04:20:17 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:20:17 user nova-compute[74540]:     </system>
Nov 07 04:20:17 user nova-compute[74540]:   </sysinfo>
Nov 07 04:20:17 user nova-compute[74540]:   <os>
Nov 07 04:20:17 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:20:17 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:20:17 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:20:17 user nova-compute[74540]:   </os>
Nov 07 04:20:17 user nova-compute[74540]:   <features>
Nov 07 04:20:17 user nova-compute[74540]:     <acpi/>
Nov 07 04:20:17 user nova-compute[74540]:     <apic/>
Nov 07 04:20:17 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:20:17 user nova-compute[74540]:   </features>
Nov 07 04:20:17 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:20:17 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:20:17 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:20:17 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:20:17 user nova-compute[74540]:   </clock>
Nov 07 04:20:17 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:20:17 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:20:17 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:20:17 user nova-compute[74540]:   </cpu>
Nov 07 04:20:17 user nova-compute[74540]:   <devices>
Nov 07 04:20:17 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:20:17 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:20:17 user nova-compute[74540]:       <source dev="/dev/sdc"/>
Nov 07 04:20:17 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:20:17 user nova-compute[74540]:       <serial>fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948</serial>
Nov 07 04:20:17 user nova-compute[74540]:     </disk>
Nov 07 04:20:17 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:20:17 user nova-compute[74540]:       <mac address="fa:16:3e:dc:6c:b2"/>
Nov 07 04:20:17 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:20:17 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:20:17 user nova-compute[74540]:       <target dev="tap5a551def-df"/>
Nov 07 04:20:17 user nova-compute[74540]:     </interface>
Nov 07 04:20:17 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:20:17 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/console.log" append="off"/>
Nov 07 04:20:17 user nova-compute[74540]:     </serial>
Nov 07 04:20:17 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:20:17 user nova-compute[74540]:     <video>
Nov 07 04:20:17 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:20:17 user nova-compute[74540]:     </video>
Nov 07 04:20:17 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:20:17 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:20:17 user nova-compute[74540]:     </rng>
Nov 07 04:20:17 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:20:17 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:20:17 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:20:17 user nova-compute[74540]:     </memballoon>
Nov 07 04:20:17 user nova-compute[74540]:   </devices>
Nov 07 04:20:17 user nova-compute[74540]: </domain>
Nov 07 04:20:17 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-983957758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-983957758',id=39,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-2vfsbnzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:19:30Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=cfdde86e-1e12-44f3-88d1-ca15a66e03e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6c:b2,bridge_name='br-int',has_traffic_filtering=True,id=5a551def-df79-49de-a5ce-f6dea568e6c8,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a551def-df') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG os_vif [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6c:b2,bridge_name='br-int',has_traffic_filtering=True,id=5a551def-df79-49de-a5ce-f6dea568e6c8,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a551def-df') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c65a7d82-6e71-5221-87cd-8751ea8ab69f', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a551def-df, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a551def-df, col_values=(('qos', UUID('9ae14422-7f89-40e1-9a0f-878821926d4f')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a551def-df, col_values=(('external_ids', {'iface-id': '5a551def-df79-49de-a5ce-f6dea568e6c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:6c:b2', 'vm-uuid': 'cfdde86e-1e12-44f3-88d1-ca15a66e03e8'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:20:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:17 user nova-compute[74540]: INFO os_vif [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6c:b2,bridge_name='br-int',has_traffic_filtering=True,id=5a551def-df79-49de-a5ce-f6dea568e6c8,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a551def-df')
Nov 07 04:20:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:20:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No VIF found with MAC fa:16:3e:dc:6c:b2, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:20:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-a0dc5549-2bb8-4ba2-866c-225e5faf8e2c req-0cc348d4-9cec-43a2-8585-c12a185eca3e service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:20:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a0dc5549-2bb8-4ba2-866c-225e5faf8e2c req-0cc348d4-9cec-43a2-8585-c12a185eca3e service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a0dc5549-2bb8-4ba2-866c-225e5faf8e2c req-0cc348d4-9cec-43a2-8585-c12a185eca3e service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a0dc5549-2bb8-4ba2-866c-225e5faf8e2c req-0cc348d4-9cec-43a2-8585-c12a185eca3e service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-a0dc5549-2bb8-4ba2-866c-225e5faf8e2c req-0cc348d4-9cec-43a2-8585-c12a185eca3e service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:20:19 user nova-compute[74540]: WARNING nova.compute.manager [req-a0dc5549-2bb8-4ba2-866c-225e5faf8e2c req-0cc348d4-9cec-43a2-8585-c12a185eca3e service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state building and task_state spawning.
Nov 07 04:20:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:20:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:20:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Instance spawned successfully.
Nov 07 04:20:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:20:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:20:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:20:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:20:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:20:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:20:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:20:22 user nova-compute[74540]: INFO nova.compute.manager [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 07 04:20:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:20:22 user nova-compute[74540]: INFO nova.compute.manager [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Took 53.06 seconds to build instance.
Nov 07 04:20:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-80589361-ca86-4342-8e14-062d202e3749 req-3862a972-4476-4b40-9bcb-bcb69f38e3e7 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-80589361-ca86-4342-8e14-062d202e3749 req-3862a972-4476-4b40-9bcb-bcb69f38e3e7 service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-80589361-ca86-4342-8e14-062d202e3749 req-3862a972-4476-4b40-9bcb-bcb69f38e3e7 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-80589361-ca86-4342-8e14-062d202e3749 req-3862a972-4476-4b40-9bcb-bcb69f38e3e7 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-80589361-ca86-4342-8e14-062d202e3749 req-3862a972-4476-4b40-9bcb-bcb69f38e3e7 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:20:22 user nova-compute[74540]: WARNING nova.compute.manager [req-80589361-ca86-4342-8e14-062d202e3749 req-3862a972-4476-4b40-9bcb-bcb69f38e3e7 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state active and task_state None.
Nov 07 04:20:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e1e7f1e2-c3e4-4269-a4e7-a44b1a3f1f69 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.157s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-91b2df69-e70e-4dfa-bd45-22c3b1752bbb req-fa7960d6-f38a-4147-a4af-7dc786c5af54 service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Received event network-changed-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-91b2df69-e70e-4dfa-bd45-22c3b1752bbb req-fa7960d6-f38a-4147-a4af-7dc786c5af54 service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Refreshing instance network info cache due to event network-changed-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-91b2df69-e70e-4dfa-bd45-22c3b1752bbb req-fa7960d6-f38a-4147-a4af-7dc786c5af54 service nova] Acquiring lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-91b2df69-e70e-4dfa-bd45-22c3b1752bbb req-fa7960d6-f38a-4147-a4af-7dc786c5af54 service nova] Acquired lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG nova.network.neutron [req-91b2df69-e70e-4dfa-bd45-22c3b1752bbb req-fa7960d6-f38a-4147-a4af-7dc786c5af54 service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Refreshing network info cache for port 6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:22 user nova-compute[74540]: INFO nova.compute.manager [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Terminating instance
Nov 07 04:20:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-91b2df69-e70e-4dfa-bd45-22c3b1752bbb req-fa7960d6-f38a-4147-a4af-7dc786c5af54 service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Updated VIF entry in instance network info cache for port 6e16179f-e4b8-4bda-a240-bb9ab9fadaf5. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-91b2df69-e70e-4dfa-bd45-22c3b1752bbb req-fa7960d6-f38a-4147-a4af-7dc786c5af54 service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Updating instance_info_cache with network_info: [{"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-91b2df69-e70e-4dfa-bd45-22c3b1752bbb req-fa7960d6-f38a-4147-a4af-7dc786c5af54 service nova] Releasing lock "refresh_cache-cc15c8fc-e47f-4df0-94ec-8daeacb112c9" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:20:23 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Instance destroyed successfully.
Nov 07 04:20:23 user nova-compute[74540]: DEBUG nova.objects.instance [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lazy-loading 'resources' on Instance uuid cc15c8fc-e47f-4df0-94ec-8daeacb112c9 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2033855906',display_name='tempest-TestStampPattern-server-2033855906',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2033855906',id=29,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoMfE2Q8gNUKNl0nmrHkjFV2OAeuMJzS+ql/IUfGPF1eNzZ6Aqxy5NrG9xZoAUwwIFWT3HNiNLxHgs0GzsPBY0ju025YOE6ZmiTIQk/+eBuGfERE2Lyjk3Ye8OTrYx9mA==',key_name='tempest-TestStampPattern-1539418775',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:12:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29f9a52c6a1044b8bc854c8a86d81827',ramdisk_id='',reservation_id='r-2djk30s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-310684050',owner_user_name='tempest-TestStampPattern-310684050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:15:51Z,user_data=None,user_id='3580d0b365fa4f2f8599747d474e8c7e',uuid=cc15c8fc-e47f-4df0-94ec-8daeacb112c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Converting VIF {"id": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "address": "fa:16:3e:7f:b8:4d", "network": {"id": "e170d9c4-e788-412f-b36f-7fdb70473dab", "bridge": "br-int", "label": "tempest-TestStampPattern-201821810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29f9a52c6a1044b8bc854c8a86d81827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e16179f-e4", "ovs_interfaceid": "6e16179f-e4b8-4bda-a240-bb9ab9fadaf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=6e16179f-e4b8-4bda-a240-bb9ab9fadaf5,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e16179f-e4') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG os_vif [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=6e16179f-e4b8-4bda-a240-bb9ab9fadaf5,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e16179f-e4') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e16179f-e4, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3e87ba2-be31-45b1-a403-ecc5dc3cf7c0) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:23 user nova-compute[74540]: INFO os_vif [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:b8:4d,bridge_name='br-int',has_traffic_filtering=True,id=6e16179f-e4b8-4bda-a240-bb9ab9fadaf5,network=Network(e170d9c4-e788-412f-b36f-7fdb70473dab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e16179f-e4')
Nov 07 04:20:23 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Deleting instance files /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9_del
Nov 07 04:20:23 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Deletion of /opt/stack/data/nova/instances/cc15c8fc-e47f-4df0-94ec-8daeacb112c9_del complete
Nov 07 04:20:23 user nova-compute[74540]: INFO nova.compute.manager [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 07 04:20:23 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:20:23 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:20:24 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Took 0.58 seconds to deallocate network for instance.
Nov 07 04:20:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-30ecd8ed-5db6-4d9b-8eb4-0a3278e15510 req-7c9c3dfd-c529-44a5-a88d-f7a762b1d107 service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Received event network-vif-deleted-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-0bdd6ca1-1f47-4158-b865-93e08adadc7a req-3fb15027-4e6f-4608-8c86-06940c17023a service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Received event network-vif-unplugged-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0bdd6ca1-1f47-4158-b865-93e08adadc7a req-3fb15027-4e6f-4608-8c86-06940c17023a service nova] Acquiring lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0bdd6ca1-1f47-4158-b865-93e08adadc7a req-3fb15027-4e6f-4608-8c86-06940c17023a service nova] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0bdd6ca1-1f47-4158-b865-93e08adadc7a req-3fb15027-4e6f-4608-8c86-06940c17023a service nova] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-0bdd6ca1-1f47-4158-b865-93e08adadc7a req-3fb15027-4e6f-4608-8c86-06940c17023a service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] No waiting events found dispatching network-vif-unplugged-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:20:24 user nova-compute[74540]: WARNING nova.compute.manager [req-0bdd6ca1-1f47-4158-b865-93e08adadc7a req-3fb15027-4e6f-4608-8c86-06940c17023a service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Received unexpected event network-vif-unplugged-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 for instance with vm_state deleted and task_state None.
Nov 07 04:20:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-0bdd6ca1-1f47-4158-b865-93e08adadc7a req-3fb15027-4e6f-4608-8c86-06940c17023a service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Received event network-vif-plugged-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0bdd6ca1-1f47-4158-b865-93e08adadc7a req-3fb15027-4e6f-4608-8c86-06940c17023a service nova] Acquiring lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0bdd6ca1-1f47-4158-b865-93e08adadc7a req-3fb15027-4e6f-4608-8c86-06940c17023a service nova] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0bdd6ca1-1f47-4158-b865-93e08adadc7a req-3fb15027-4e6f-4608-8c86-06940c17023a service nova] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-0bdd6ca1-1f47-4158-b865-93e08adadc7a req-3fb15027-4e6f-4608-8c86-06940c17023a service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] No waiting events found dispatching network-vif-plugged-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:20:24 user nova-compute[74540]: WARNING nova.compute.manager [req-0bdd6ca1-1f47-4158-b865-93e08adadc7a req-3fb15027-4e6f-4608-8c86-06940c17023a service nova] [instance: cc15c8fc-e47f-4df0-94ec-8daeacb112c9] Received unexpected event network-vif-plugged-6e16179f-e4b8-4bda-a240-bb9ab9fadaf5 for instance with vm_state deleted and task_state None.
Nov 07 04:20:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:25 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Deleted allocations for instance cc15c8fc-e47f-4df0-94ec-8daeacb112c9
Nov 07 04:20:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-58faf62d-dae5-4a75-a28d-d71b536f9bf2 tempest-TestStampPattern-310684050 tempest-TestStampPattern-310684050-project-member] Lock "cc15c8fc-e47f-4df0-94ec-8daeacb112c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.417s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:20:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:20:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:20:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:20:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:20:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:43 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:20:43 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:20:45 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:20:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:47 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:20:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:20:49 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:20:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:20:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:51 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:20:51 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:20:52 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:20:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:52 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:20:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:20:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:20:55 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:20:55 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:20:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8208MB free_disk=24.81717300415039GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 9c425dfc-962a-4d21-ba9b-110fed764c51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance eab83056-14bd-4dd3-bcd0-7bc25cb8f722 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cfdde86e-1e12-44f3-88d1-ca15a66e03e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:20:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:20:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:20:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:01 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:21:01 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:21:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-eab83056-14bd-4dd3-bcd0-7bc25cb8f722" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:21:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-eab83056-14bd-4dd3-bcd0-7bc25cb8f722" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:21:01 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:21:02 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Updating instance_info_cache with network_info: [{"id": "9635f951-17ba-47fc-91d9-105fca414382", "address": "fa:16:3e:74:86:27", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9635f951-17", "ovs_interfaceid": "9635f951-17ba-47fc-91d9-105fca414382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:21:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-eab83056-14bd-4dd3-bcd0-7bc25cb8f722" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:21:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:21:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:21:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "9c425dfc-962a-4d21-ba9b-110fed764c51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:18 user nova-compute[74540]: INFO nova.compute.manager [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Terminating instance
Nov 07 04:21:18 user nova-compute[74540]: DEBUG nova.compute.manager [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:21:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-0e031bee-2365-42d7-a15c-dc1c8113d9f2 req-646642a8-1d78-42c0-9413-ab192941565e service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Received event network-vif-unplugged-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0e031bee-2365-42d7-a15c-dc1c8113d9f2 req-646642a8-1d78-42c0-9413-ab192941565e service nova] Acquiring lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0e031bee-2365-42d7-a15c-dc1c8113d9f2 req-646642a8-1d78-42c0-9413-ab192941565e service nova] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0e031bee-2365-42d7-a15c-dc1c8113d9f2 req-646642a8-1d78-42c0-9413-ab192941565e service nova] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-0e031bee-2365-42d7-a15c-dc1c8113d9f2 req-646642a8-1d78-42c0-9413-ab192941565e service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] No waiting events found dispatching network-vif-unplugged-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-0e031bee-2365-42d7-a15c-dc1c8113d9f2 req-646642a8-1d78-42c0-9413-ab192941565e service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Received event network-vif-unplugged-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:19 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Instance destroyed successfully.
Nov 07 04:21:19 user nova-compute[74540]: DEBUG nova.objects.instance [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lazy-loading 'resources' on Instance uuid 9c425dfc-962a-4d21-ba9b-110fed764c51 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:02:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1677579046',display_name='tempest-ServerActionsTestOtherA-server-1677579046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1677579046',id=15,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwNZBrKGScuWsQUPfoY0b3AbxyGKSkLExG0cpMUZnRvSTxBRcsFtIZ1RT1pR1+eCQdUJD5DJCUo9GsJbQ2Fmr9SGNPRCHO5qhdeLD9soxcgYrMJdlf2ABhS3l6lT6tLnQ==',key_name='tempest-keypair-987204751',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:02:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e4bbbf680d48fe8534c9ebe909fd50',ramdisk_id='',reservation_id='r-vdow37ap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-28801548',owner_user_name='tempest-ServerActionsTestOtherA-28801548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd0ca1c305c04866b3323a98c6796ded',uuid=9c425dfc-962a-4d21-ba9b-110fed764c51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converting VIF {"id": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "address": "fa:16:3e:1b:76:dd", "network": {"id": "743048cf-5514-4087-bebc-db74282f3c23", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-839286673-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e4bbbf680d48fe8534c9ebe909fd50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9c9da0-8f", "ovs_interfaceid": "ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:76:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9c9da0-8f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG os_vif [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:76:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9c9da0-8f') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba9c9da0-8f, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10cf635c-ff0e-47d4-bd55-6245b9e42237) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:21:19 user nova-compute[74540]: INFO os_vif [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:76:dd,bridge_name='br-int',has_traffic_filtering=True,id=ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e,network=Network(743048cf-5514-4087-bebc-db74282f3c23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9c9da0-8f')
Nov 07 04:21:19 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Deleting instance files /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51_del
Nov 07 04:21:19 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Deletion of /opt/stack/data/nova/instances/9c425dfc-962a-4d21-ba9b-110fed764c51_del complete
Nov 07 04:21:19 user nova-compute[74540]: INFO nova.compute.manager [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 07 04:21:19 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:21:19 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:21:20 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:21:20 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Took 0.61 seconds to deallocate network for instance.
Nov 07 04:21:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:20 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:21:20 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:21:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:20 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Deleted allocations for instance 9c425dfc-962a-4d21-ba9b-110fed764c51
Nov 07 04:21:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-6b27d295-1a81-480b-aee6-d40b967f8e59 tempest-ServerActionsTestOtherA-28801548 tempest-ServerActionsTestOtherA-28801548-project-member] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.061s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-93aa936c-b8ff-4aeb-ae0b-46f73d637bcd req-df9f5705-412e-4298-9003-c9e18598109d service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Received event network-vif-plugged-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:21:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-93aa936c-b8ff-4aeb-ae0b-46f73d637bcd req-df9f5705-412e-4298-9003-c9e18598109d service nova] Acquiring lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-93aa936c-b8ff-4aeb-ae0b-46f73d637bcd req-df9f5705-412e-4298-9003-c9e18598109d service nova] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-93aa936c-b8ff-4aeb-ae0b-46f73d637bcd req-df9f5705-412e-4298-9003-c9e18598109d service nova] Lock "9c425dfc-962a-4d21-ba9b-110fed764c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-93aa936c-b8ff-4aeb-ae0b-46f73d637bcd req-df9f5705-412e-4298-9003-c9e18598109d service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] No waiting events found dispatching network-vif-plugged-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:21:21 user nova-compute[74540]: WARNING nova.compute.manager [req-93aa936c-b8ff-4aeb-ae0b-46f73d637bcd req-df9f5705-412e-4298-9003-c9e18598109d service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Received unexpected event network-vif-plugged-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e for instance with vm_state deleted and task_state None.
Nov 07 04:21:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-93aa936c-b8ff-4aeb-ae0b-46f73d637bcd req-df9f5705-412e-4298-9003-c9e18598109d service nova] [instance: 9c425dfc-962a-4d21-ba9b-110fed764c51] Received event network-vif-deleted-ba9c9da0-8ff1-4ba9-a051-bfb6e0d65c4e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:21:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:21:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:45 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:21:45 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:21:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:48 user nova-compute[74540]: DEBUG nova.compute.manager [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:21:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:21:48 user nova-compute[74540]: INFO nova.compute.claims [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Claim successful on node user
Nov 07 04:21:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:21:48 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:21:48 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:21:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:48 user nova-compute[74540]: DEBUG nova.compute.manager [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG nova.network.neutron [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:21:49 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:21:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG nova.policy [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c9c8a93cc874aaeaf8f6bda9bad3974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151659fcbec241f7ae4ecd1516724fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG nova.compute.manager [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:21:49 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Creating image(s)
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "/opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "/opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "/opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.234s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.254s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk 1073741824" returned: 0 in 0.057s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:49 user nova-compute[74540]: DEBUG nova.network.neutron [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Successfully created port: 76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.216s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Cannot resize image /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Ensure instance console log exists: /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Successfully updated port: 76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "refresh_cache-dce42579-e49b-472a-bb91-e6c3365d5553" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquired lock "refresh_cache-dce42579-e49b-472a-bb91-e6c3365d5553" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-49dd4d0c-97e1-4b47-a416-210c74ed02f6 req-9a4590ce-59e0-482e-8446-2033fc9d0de4 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Received event network-changed-76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-49dd4d0c-97e1-4b47-a416-210c74ed02f6 req-9a4590ce-59e0-482e-8446-2033fc9d0de4 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Refreshing instance network info cache due to event network-changed-76adb4f7-18f1-44d2-8109-fb2f8b05927d. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-49dd4d0c-97e1-4b47-a416-210c74ed02f6 req-9a4590ce-59e0-482e-8446-2033fc9d0de4 service nova] Acquiring lock "refresh_cache-dce42579-e49b-472a-bb91-e6c3365d5553" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:21:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.network.neutron [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Updating instance_info_cache with network_info: [{"id": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "address": "fa:16:3e:e5:a0:97", "network": {"id": "e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-278886072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151659fcbec241f7ae4ecd1516724fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adb4f7-18", "ovs_interfaceid": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Releasing lock "refresh_cache-dce42579-e49b-472a-bb91-e6c3365d5553" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Instance network_info: |[{"id": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "address": "fa:16:3e:e5:a0:97", "network": {"id": "e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-278886072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151659fcbec241f7ae4ecd1516724fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adb4f7-18", "ovs_interfaceid": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-49dd4d0c-97e1-4b47-a416-210c74ed02f6 req-9a4590ce-59e0-482e-8446-2033fc9d0de4 service nova] Acquired lock "refresh_cache-dce42579-e49b-472a-bb91-e6c3365d5553" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.network.neutron [req-49dd4d0c-97e1-4b47-a416-210c74ed02f6 req-9a4590ce-59e0-482e-8446-2033fc9d0de4 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Refreshing network info cache for port 76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Start _get_guest_xml network_info=[{"id": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "address": "fa:16:3e:e5:a0:97", "network": {"id": "e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-278886072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151659fcbec241f7ae4ecd1516724fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adb4f7-18", "ovs_interfaceid": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:21:51 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:21:51 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1057099899',display_name='tempest-TestServerVolumeAttachmentScenario-server-1057099899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1057099899',id=40,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBVqickahYBVFhD25NXpPeJnv7W7SpRXHzMejAOG4lGZ2Rk9gMUs0zmGNhsh+VyWR50GNyOrhVxFG9VOJKFPukiR0bAQaYE2aAldBKgFGUHK5Sw5B9zlTuXWQISkpt7kA==',key_name='tempest-keypair-1258064914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='151659fcbec241f7ae4ecd1516724fda',ramdisk_id='',reservation_id='r-xzxfnhzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1983912952',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1983912952-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c9c8a93cc874aaeaf8f6bda9bad3974',uuid=dce42579-e49b-472a-bb91-e6c3365d5553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "address": "fa:16:3e:e5:a0:97", "network": {"id": "e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-278886072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151659fcbec241f7ae4ecd1516724fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adb4f7-18", "ovs_interfaceid": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Converting VIF {"id": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "address": "fa:16:3e:e5:a0:97", "network": {"id": "e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-278886072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151659fcbec241f7ae4ecd1516724fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adb4f7-18", "ovs_interfaceid": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a0:97,bridge_name='br-int',has_traffic_filtering=True,id=76adb4f7-18f1-44d2-8109-fb2f8b05927d,network=Network(e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adb4f7-18') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.objects.instance [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lazy-loading 'pci_devices' on Instance uuid dce42579-e49b-472a-bb91-e6c3365d5553 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:21:51 user nova-compute[74540]:   <uuid>dce42579-e49b-472a-bb91-e6c3365d5553</uuid>
Nov 07 04:21:51 user nova-compute[74540]:   <name>instance-00000028</name>
Nov 07 04:21:51 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:21:51 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:21:51 user nova-compute[74540]:   <metadata>
Nov 07 04:21:51 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:21:51 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:21:51 user nova-compute[74540]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1057099899</nova:name>
Nov 07 04:21:51 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:21:51</nova:creationTime>
Nov 07 04:21:51 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:21:51 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:21:51 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:21:51 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:21:51 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:21:51 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:21:51 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:21:51 user nova-compute[74540]:       <nova:owner>
Nov 07 04:21:51 user nova-compute[74540]:         <nova:user uuid="9c9c8a93cc874aaeaf8f6bda9bad3974">tempest-TestServerVolumeAttachmentScenario-1983912952-project-member</nova:user>
Nov 07 04:21:51 user nova-compute[74540]:         <nova:project uuid="151659fcbec241f7ae4ecd1516724fda">tempest-TestServerVolumeAttachmentScenario-1983912952</nova:project>
Nov 07 04:21:51 user nova-compute[74540]:       </nova:owner>
Nov 07 04:21:51 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:21:51 user nova-compute[74540]:       <nova:ports>
Nov 07 04:21:51 user nova-compute[74540]:         <nova:port uuid="76adb4f7-18f1-44d2-8109-fb2f8b05927d">
Nov 07 04:21:51 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 07 04:21:51 user nova-compute[74540]:         </nova:port>
Nov 07 04:21:51 user nova-compute[74540]:       </nova:ports>
Nov 07 04:21:51 user nova-compute[74540]:     </nova:instance>
Nov 07 04:21:51 user nova-compute[74540]:   </metadata>
Nov 07 04:21:51 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:21:51 user nova-compute[74540]:     <system>
Nov 07 04:21:51 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:21:51 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:21:51 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:21:51 user nova-compute[74540]:       <entry name="serial">dce42579-e49b-472a-bb91-e6c3365d5553</entry>
Nov 07 04:21:51 user nova-compute[74540]:       <entry name="uuid">dce42579-e49b-472a-bb91-e6c3365d5553</entry>
Nov 07 04:21:51 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:21:51 user nova-compute[74540]:     </system>
Nov 07 04:21:51 user nova-compute[74540]:   </sysinfo>
Nov 07 04:21:51 user nova-compute[74540]:   <os>
Nov 07 04:21:51 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:21:51 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:21:51 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:21:51 user nova-compute[74540]:   </os>
Nov 07 04:21:51 user nova-compute[74540]:   <features>
Nov 07 04:21:51 user nova-compute[74540]:     <acpi/>
Nov 07 04:21:51 user nova-compute[74540]:     <apic/>
Nov 07 04:21:51 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:21:51 user nova-compute[74540]:   </features>
Nov 07 04:21:51 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:21:51 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:21:51 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:21:51 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:21:51 user nova-compute[74540]:   </clock>
Nov 07 04:21:51 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:21:51 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:21:51 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:21:51 user nova-compute[74540]:   </cpu>
Nov 07 04:21:51 user nova-compute[74540]:   <devices>
Nov 07 04:21:51 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:21:51 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:21:51 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk"/>
Nov 07 04:21:51 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:21:51 user nova-compute[74540]:     </disk>
Nov 07 04:21:51 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:21:51 user nova-compute[74540]:       <mac address="fa:16:3e:e5:a0:97"/>
Nov 07 04:21:51 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:21:51 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:21:51 user nova-compute[74540]:       <target dev="tap76adb4f7-18"/>
Nov 07 04:21:51 user nova-compute[74540]:     </interface>
Nov 07 04:21:51 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:21:51 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/console.log" append="off"/>
Nov 07 04:21:51 user nova-compute[74540]:     </serial>
Nov 07 04:21:51 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:21:51 user nova-compute[74540]:     <video>
Nov 07 04:21:51 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:21:51 user nova-compute[74540]:     </video>
Nov 07 04:21:51 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:21:51 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:21:51 user nova-compute[74540]:     </rng>
Nov 07 04:21:51 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:21:51 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:21:51 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:21:51 user nova-compute[74540]:     </memballoon>
Nov 07 04:21:51 user nova-compute[74540]:   </devices>
Nov 07 04:21:51 user nova-compute[74540]: </domain>
Nov 07 04:21:51 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1057099899',display_name='tempest-TestServerVolumeAttachmentScenario-server-1057099899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1057099899',id=40,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBVqickahYBVFhD25NXpPeJnv7W7SpRXHzMejAOG4lGZ2Rk9gMUs0zmGNhsh+VyWR50GNyOrhVxFG9VOJKFPukiR0bAQaYE2aAldBKgFGUHK5Sw5B9zlTuXWQISkpt7kA==',key_name='tempest-keypair-1258064914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='151659fcbec241f7ae4ecd1516724fda',ramdisk_id='',reservation_id='r-xzxfnhzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1983912952',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1983912952-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c9c8a93cc874aaeaf8f6bda9bad3974',uuid=dce42579-e49b-472a-bb91-e6c3365d5553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "address": "fa:16:3e:e5:a0:97", "network": {"id": "e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-278886072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151659fcbec241f7ae4ecd1516724fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adb4f7-18", "ovs_interfaceid": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Converting VIF {"id": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "address": "fa:16:3e:e5:a0:97", "network": {"id": "e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-278886072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151659fcbec241f7ae4ecd1516724fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adb4f7-18", "ovs_interfaceid": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a0:97,bridge_name='br-int',has_traffic_filtering=True,id=76adb4f7-18f1-44d2-8109-fb2f8b05927d,network=Network(e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adb4f7-18') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG os_vif [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a0:97,bridge_name='br-int',has_traffic_filtering=True,id=76adb4f7-18f1-44d2-8109-fb2f8b05927d,network=Network(e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adb4f7-18') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99a69e59-9c18-5ccd-9c98-58036cf49008', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76adb4f7-18, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76adb4f7-18, col_values=(('qos', UUID('bf679a6b-b2a1-4b9b-b300-165e4eb4be21')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76adb4f7-18, col_values=(('external_ids', {'iface-id': '76adb4f7-18f1-44d2-8109-fb2f8b05927d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:a0:97', 'vm-uuid': 'dce42579-e49b-472a-bb91-e6c3365d5553'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:51 user nova-compute[74540]: INFO os_vif [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a0:97,bridge_name='br-int',has_traffic_filtering=True,id=76adb4f7-18f1-44d2-8109-fb2f8b05927d,network=Network(e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adb4f7-18')
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] No VIF found with MAC fa:16:3e:e5:a0:97, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:21:51 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:21:52 user nova-compute[74540]: DEBUG nova.network.neutron [req-49dd4d0c-97e1-4b47-a416-210c74ed02f6 req-9a4590ce-59e0-482e-8446-2033fc9d0de4 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Updated VIF entry in instance network info cache for port 76adb4f7-18f1-44d2-8109-fb2f8b05927d. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:21:52 user nova-compute[74540]: DEBUG nova.network.neutron [req-49dd4d0c-97e1-4b47-a416-210c74ed02f6 req-9a4590ce-59e0-482e-8446-2033fc9d0de4 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Updating instance_info_cache with network_info: [{"id": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "address": "fa:16:3e:e5:a0:97", "network": {"id": "e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-278886072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151659fcbec241f7ae4ecd1516724fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adb4f7-18", "ovs_interfaceid": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:21:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-49dd4d0c-97e1-4b47-a416-210c74ed02f6 req-9a4590ce-59e0-482e-8446-2033fc9d0de4 service nova] Releasing lock "refresh_cache-dce42579-e49b-472a-bb91-e6c3365d5553" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:21:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-717de81b-9f78-450a-8645-3c43fc318c30 req-225e8ae7-869a-45ac-a099-9c3c8a42b2d4 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Received event network-vif-plugged-76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:21:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-717de81b-9f78-450a-8645-3c43fc318c30 req-225e8ae7-869a-45ac-a099-9c3c8a42b2d4 service nova] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-717de81b-9f78-450a-8645-3c43fc318c30 req-225e8ae7-869a-45ac-a099-9c3c8a42b2d4 service nova] Lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-717de81b-9f78-450a-8645-3c43fc318c30 req-225e8ae7-869a-45ac-a099-9c3c8a42b2d4 service nova] Lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-717de81b-9f78-450a-8645-3c43fc318c30 req-225e8ae7-869a-45ac-a099-9c3c8a42b2d4 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] No waiting events found dispatching network-vif-plugged-76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:21:53 user nova-compute[74540]: WARNING nova.compute.manager [req-717de81b-9f78-450a-8645-3c43fc318c30 req-225e8ae7-869a-45ac-a099-9c3c8a42b2d4 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Received unexpected event network-vif-plugged-76adb4f7-18f1-44d2-8109-fb2f8b05927d for instance with vm_state building and task_state spawning.
Nov 07 04:21:53 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:21:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:54 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:21:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-a11020e1-3799-442c-a0f4-a84d0ea2ffd6 req-7d386bfb-1416-47dc-9556-69e6ff66763f service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Received event network-vif-plugged-76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a11020e1-3799-442c-a0f4-a84d0ea2ffd6 req-7d386bfb-1416-47dc-9556-69e6ff66763f service nova] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a11020e1-3799-442c-a0f4-a84d0ea2ffd6 req-7d386bfb-1416-47dc-9556-69e6ff66763f service nova] Lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a11020e1-3799-442c-a0f4-a84d0ea2ffd6 req-7d386bfb-1416-47dc-9556-69e6ff66763f service nova] Lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-a11020e1-3799-442c-a0f4-a84d0ea2ffd6 req-7d386bfb-1416-47dc-9556-69e6ff66763f service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] No waiting events found dispatching network-vif-plugged-76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:21:55 user nova-compute[74540]: WARNING nova.compute.manager [req-a11020e1-3799-442c-a0f4-a84d0ea2ffd6 req-7d386bfb-1416-47dc-9556-69e6ff66763f service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Received unexpected event network-vif-plugged-76adb4f7-18f1-44d2-8109-fb2f8b05927d for instance with vm_state building and task_state spawning.
Nov 07 04:21:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:21:55 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Instance spawned successfully.
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:21:55 user nova-compute[74540]: INFO nova.compute.manager [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Took 6.62 seconds to spawn the instance on the hypervisor.
Nov 07 04:21:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:55 user nova-compute[74540]: INFO nova.compute.manager [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Took 7.61 seconds to build instance.
Nov 07 04:21:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-40eac9f6-aa33-4777-9e81-bdcb2fbe8140 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.821s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:21:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:21:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:21:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:21:57 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:21:57 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:21:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8347MB free_disk=24.831012725830078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance eab83056-14bd-4dd3-bcd0-7bc25cb8f722 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cfdde86e-1e12-44f3-88d1-ca15a66e03e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance dce42579-e49b-472a-bb91-e6c3365d5553 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:21:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:22:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:22:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:22:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:22:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:22:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:22:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:03 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:03 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:22:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-47f331c2-4e12-45cc-8b9d-a566a0dbbca1" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:22:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-47f331c2-4e12-45cc-8b9d-a566a0dbbca1" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:22:03 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:22:04 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Updating instance_info_cache with network_info: [{"id": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "address": "fa:16:3e:95:b2:60", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b9d20a-b1", "ovs_interfaceid": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:22:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-47f331c2-4e12-45cc-8b9d-a566a0dbbca1" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:22:04 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:22:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:10 user nova-compute[74540]: INFO nova.compute.manager [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Rescuing
Nov 07 04:22:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "refresh_cache-cfdde86e-1e12-44f3-88d1-ca15a66e03e8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:22:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquired lock "refresh_cache-cfdde86e-1e12-44f3-88d1-ca15a66e03e8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:22:10 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:22:11 user nova-compute[74540]: DEBUG nova.network.neutron [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Updating instance_info_cache with network_info: [{"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:22:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Releasing lock "refresh_cache-cfdde86e-1e12-44f3-88d1-ca15a66e03e8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:22:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-a15c1d03-6c11-4933-9ae5-7c0c341d75f5 req-33d17dd6-546c-422e-9ab5-467b890bdb8b service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-unplugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:22:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a15c1d03-6c11-4933-9ae5-7c0c341d75f5 req-33d17dd6-546c-422e-9ab5-467b890bdb8b service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:22:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a15c1d03-6c11-4933-9ae5-7c0c341d75f5 req-33d17dd6-546c-422e-9ab5-467b890bdb8b service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:22:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a15c1d03-6c11-4933-9ae5-7c0c341d75f5 req-33d17dd6-546c-422e-9ab5-467b890bdb8b service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:22:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-a15c1d03-6c11-4933-9ae5-7c0c341d75f5 req-33d17dd6-546c-422e-9ab5-467b890bdb8b service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-unplugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:22:11 user nova-compute[74540]: WARNING nova.compute.manager [req-a15c1d03-6c11-4933-9ae5-7c0c341d75f5 req-33d17dd6-546c-422e-9ab5-467b890bdb8b service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-unplugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state active and task_state rescuing.
Nov 07 04:22:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:12 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Instance destroyed successfully.
Nov 07 04:22:12 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Attempting a stable device rescue
Nov 07 04:22:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74540) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 07 04:22:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Instance directory exists: not creating {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 07 04:22:12 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Creating image(s)
Nov 07 04:22:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:22:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "/opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:22:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "/opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:22:12 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'trusted_certs' on Instance uuid cfdde86e-1e12-44f3-88d1-ca15a66e03e8 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:22:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "c006b62192ca4015ad8f8370aea357cfd7efff3c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:22:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "c006b62192ca4015ad8f8370aea357cfd7efff3c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:22:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c.part --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c.part --force-share --output=json" returned: 0 in 0.213s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:13 user nova-compute[74540]: DEBUG nova.virt.images [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] 01e82ee6-082f-4aac-a1b6-5110c4362467 was qcow2, converting to raw {{(pid=74540) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 04:22:13 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:22:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c.part /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c.converted {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:13 user nova-compute[74540]: DEBUG nova.compute.manager [req-4b01e469-587b-4c73-87ef-0bb174345249 req-05fc1d7c-9687-4a7c-ad26-6bb1789ea112 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:22:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4b01e469-587b-4c73-87ef-0bb174345249 req-05fc1d7c-9687-4a7c-ad26-6bb1789ea112 service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:22:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4b01e469-587b-4c73-87ef-0bb174345249 req-05fc1d7c-9687-4a7c-ad26-6bb1789ea112 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:22:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4b01e469-587b-4c73-87ef-0bb174345249 req-05fc1d7c-9687-4a7c-ad26-6bb1789ea112 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:22:13 user nova-compute[74540]: DEBUG nova.compute.manager [req-4b01e469-587b-4c73-87ef-0bb174345249 req-05fc1d7c-9687-4a7c-ad26-6bb1789ea112 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:22:13 user nova-compute[74540]: WARNING nova.compute.manager [req-4b01e469-587b-4c73-87ef-0bb174345249 req-05fc1d7c-9687-4a7c-ad26-6bb1789ea112 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state active and task_state rescuing.
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c.part /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c.converted" returned: 0 in 0.654s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c.converted --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "c006b62192ca4015ad8f8370aea357cfd7efff3c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.307s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "c006b62192ca4015ad8f8370aea357cfd7efff3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "c006b62192ca4015ad8f8370aea357cfd7efff3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c,backing_fmt=raw /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.rescue {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c,backing_fmt=raw /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.rescue" returned: 0 in 0.057s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "c006b62192ca4015ad8f8370aea357cfd7efff3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'migration_context' on Instance uuid cfdde86e-1e12-44f3-88d1-ca15a66e03e8 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.objects.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Object Instance<cfdde86e-1e12-44f3-88d1-ca15a66e03e8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Start _get_guest_xml network_info=[{"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "vif_mac": "fa:16:3e:dc:6c:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '01e82ee6-082f-4aac-a1b6-5110c4362467', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIZCrXMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'cfdde86e-1e12-44f3-88d1-ca15a66e03e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948', 'serial': 'fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948'}, 'boot_index': 0, 'attachment_id': '621ddc66-be2c-46a7-a4b4-cb2b607409e4', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'resources' on Instance uuid cfdde86e-1e12-44f3-88d1-ca15a66e03e8 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.objects.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Object Instance<cfdde86e-1e12-44f3-88d1-ca15a66e03e8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'numa_topology' on Instance uuid cfdde86e-1e12-44f3-88d1-ca15a66e03e8 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.objects.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Object Instance<cfdde86e-1e12-44f3-88d1-ca15a66e03e8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:22:14 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:22:14 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'vcpu_model' on Instance uuid cfdde86e-1e12-44f3-88d1-ca15a66e03e8 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.objects.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Object Instance<cfdde86e-1e12-44f3-88d1-ca15a66e03e8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIZCrXMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:22:14 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:22:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:22:14 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:22:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:22:14 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c74dff-83ae-48e5-bd44-1c664fbf832b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yIZCrXMg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 07 04:22:14 user nova-compute[74540]: node.name = iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948
Nov 07 04:22:14 user nova-compute[74540]: node.tpgt = -1
Nov 07 04:22:14 user nova-compute[74540]: node.startup = automatic
Nov 07 04:22:14 user nova-compute[74540]: node.leading_login = No
Nov 07 04:22:14 user nova-compute[74540]: iface.iscsi_ifacename = default
Nov 07 04:22:14 user nova-compute[74540]: iface.net_ifacename = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.ipaddress = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.prefix_len = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.hwaddress = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.transport_name = tcp
Nov 07 04:22:14 user nova-compute[74540]: iface.initiatorname = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.state = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.vlan_id = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.vlan_priority = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.vlan_state = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.iface_num = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.mtu = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.port = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.bootproto = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.subnet_mask = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.gateway = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.dhcp_alt_client_id_state = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.dhcp_alt_client_id = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.dhcp_dns = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.dhcp_learn_iqn = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.dhcp_req_vendor_id_state = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.dhcp_vendor_id_state = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.dhcp_vendor_id = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.dhcp_slp_da = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.fragmentation = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.gratuitous_arp = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.incoming_forwarding = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.tos_state = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.tos = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.ttl = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.delayed_ack = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.tcp_nagle = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.tcp_wsf_state = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.tcp_wsf = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.tcp_timer_scale = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.tcp_timestamp = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.redirect = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.def_task_mgmt_timeout = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.header_digest = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.data_digest = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.immediate_data = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.initial_r2t = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.data_seq_inorder = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.data_pdu_inorder = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.erl = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.max_receive_data_len = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.first_burst_len = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.max_outstanding_r2t = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.max_burst_len = 0
Nov 07 04:22:14 user nova-compute[74540]: iface.chap_auth = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.bidi_chap = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.strict_login_compliance = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.discovery_auth = <empty>
Nov 07 04:22:14 user nova-compute[74540]: iface.discovery_logout = <empty>
Nov 07 04:22:14 user nova-compute[74540]: node.discovery_address = <empty>
Nov 07 04:22:14 user nova-compute[74540]: node.discovery_port = 0
Nov 07 04:22:14 user nova-compute[74540]: node.discovery_type = static
Nov 07 04:22:14 user nova-compute[74540]: node.session.initial_cmdsn = 0
Nov 07 04:22:14 user nova-compute[74540]: node.session.initial_login_retry_max = 8
Nov 07 04:22:14 user nova-compute[74540]: node.session.xmit_thread_priority = -20
Nov 07 04:22:14 user nova-compute[74540]: node.session.cmds_max = 128
Nov 07 04:22:14 user nova-compute[74540]: node.session.queue_depth = 32
Nov 07 04:22:14 user nova-compute[74540]: node.session.nr_sessions = 1
Nov 07 04:22:14 user nova-compute[74540]: node.session.auth.authmethod = CHAP
Nov 07 04:22:14 user nova-compute[74540]: node.session.auth.username = yIZCrXMg
Nov 07 04:22:14 user nova-compute[74540]: node.session.auth.password = ***
Nov 07 04:22:14 user nova-compute[74540]: node.session.auth.username_in = <empty>
Nov 07 04:22:14 user nova-compute[74540]: node.session.auth.password_in = <empty>
Nov 07 04:22:14 user nova-compute[74540]: node.session.auth.chap_algs = MD5
Nov 07 04:22:14 user nova-compute[74540]: node.session.timeo.replacement_timeout = 120
Nov 07 04:22:14 user nova-compute[74540]: node.session.err_timeo.abort_timeout = 15
Nov 07 04:22:14 user nova-compute[74540]: node.session.err_timeo.lu_reset_timeout = 30
Nov 07 04:22:14 user nova-compute[74540]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 07 04:22:14 user nova-compute[74540]: node.session.err_timeo.host_reset_timeout = 60
Nov 07 04:22:14 user nova-compute[74540]: node.session.iscsi.FastAbort = Yes
Nov 07 04:22:14 user nova-compute[74540]: node.session.iscsi.InitialR2T = No
Nov 07 04:22:14 user nova-compute[74540]: node.session.iscsi.ImmediateData = Yes
Nov 07 04:22:14 user nova-compute[74540]: node.session.iscsi.FirstBurstLength = 262144
Nov 07 04:22:14 user nova-compute[74540]: node.session.iscsi.MaxBurstLength = 16776192
Nov 07 04:22:14 user nova-compute[74540]: node.session.iscsi.DefaultTime2Retain = 0
Nov 07 04:22:14 user nova-compute[74540]: node.session.iscsi.DefaultTime2Wait = 2
Nov 07 04:22:14 user nova-compute[74540]: node.session.iscsi.MaxConnections = 1
Nov 07 04:22:14 user nova-compute[74540]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 07 04:22:14 user nova-compute[74540]: node.session.iscsi.ERL = 0
Nov 07 04:22:14 user nova-compute[74540]: node.session.scan = manual
Nov 07 04:22:14 user nova-compute[74540]: node.session.reopen_max = 0
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].address = 172.16.0.220
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].port = 3260
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].startup = manual
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].tcp.window_size = 524288
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].tcp.type_of_service = 0
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].timeo.logout_timeout = 15
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].timeo.login_timeout = 15
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].timeo.auth_timeout = 45
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].timeo.noop_out_interval = 5
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].timeo.noop_out_timeout = 5
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].iscsi.HeaderDigest = None
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].iscsi.DataDigest = None
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].iscsi.IFMarker = No
Nov 07 04:22:14 user nova-compute[74540]: node.conn[0].iscsi.OFMarker = No
Nov 07 04:22:14 user nova-compute[74540]: # END RECORD
Nov 07 04:22:14 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[447ed88b-ff0f-46c1-bb14-2897062e2984]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f311d5ec-ea4b-4cd5-889a-3ef52ed2da3c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIZCrXMg {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIZCrXMg" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecc5301-cb32-46cb-abcc-c376eda12930]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yIZCrXMg'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6480dfe-9180-4457-954c-1559dcd7bd3a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:22:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[be86994b-ccfb-435a-9a29-879898f2bc48]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:22:15 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:22:15 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:22:15 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:22:15 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] HCTL ('34', '0', '0', 0) found on session 42 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7da92b-67de-4f5e-8b0e-3325f4fb2c28]: (4, ('0 0 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Searching for a device in session 42 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIZCrXMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.204s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '23730343230373461', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730343230373461', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-983957758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-983957758',id=39,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-2vfsbnzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:20:22Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=cfdde86e-1e12-44f3-88d1-ca15a66e03e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "vif_mac": "fa:16:3e:dc:6c:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "vif_mac": "fa:16:3e:dc:6c:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6c:b2,bridge_name='br-int',has_traffic_filtering=True,id=5a551def-df79-49de-a5ce-f6dea568e6c8,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a551def-df') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'pci_devices' on Instance uuid cfdde86e-1e12-44f3-88d1-ca15a66e03e8 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG nova.objects.base [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Object Instance<cfdde86e-1e12-44f3-88d1-ca15a66e03e8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:22:15 user nova-compute[74540]:   <uuid>cfdde86e-1e12-44f3-88d1-ca15a66e03e8</uuid>
Nov 07 04:22:15 user nova-compute[74540]:   <name>instance-00000027</name>
Nov 07 04:22:15 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:22:15 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:22:15 user nova-compute[74540]:   <metadata>
Nov 07 04:22:15 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:22:15 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:22:15 user nova-compute[74540]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-983957758</nova:name>
Nov 07 04:22:15 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:22:14</nova:creationTime>
Nov 07 04:22:15 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:22:15 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:22:15 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:22:15 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:22:15 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:22:15 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:22:15 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:22:15 user nova-compute[74540]:       <nova:owner>
Nov 07 04:22:15 user nova-compute[74540]:         <nova:user uuid="99ba0f9acca84cdb8cf90c4b313e1b7c">tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member</nova:user>
Nov 07 04:22:15 user nova-compute[74540]:         <nova:project uuid="438cd05cbdb34608940422562ba150c8">tempest-ServerBootFromVolumeStableRescueTest-1329597446</nova:project>
Nov 07 04:22:15 user nova-compute[74540]:       </nova:owner>
Nov 07 04:22:15 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:22:15 user nova-compute[74540]:       <nova:ports>
Nov 07 04:22:15 user nova-compute[74540]:         <nova:port uuid="5a551def-df79-49de-a5ce-f6dea568e6c8">
Nov 07 04:22:15 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 07 04:22:15 user nova-compute[74540]:         </nova:port>
Nov 07 04:22:15 user nova-compute[74540]:       </nova:ports>
Nov 07 04:22:15 user nova-compute[74540]:     </nova:instance>
Nov 07 04:22:15 user nova-compute[74540]:   </metadata>
Nov 07 04:22:15 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:22:15 user nova-compute[74540]:     <system>
Nov 07 04:22:15 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:22:15 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:22:15 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:22:15 user nova-compute[74540]:       <entry name="serial">cfdde86e-1e12-44f3-88d1-ca15a66e03e8</entry>
Nov 07 04:22:15 user nova-compute[74540]:       <entry name="uuid">cfdde86e-1e12-44f3-88d1-ca15a66e03e8</entry>
Nov 07 04:22:15 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:22:15 user nova-compute[74540]:     </system>
Nov 07 04:22:15 user nova-compute[74540]:   </sysinfo>
Nov 07 04:22:15 user nova-compute[74540]:   <os>
Nov 07 04:22:15 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:22:15 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:22:15 user nova-compute[74540]:   </os>
Nov 07 04:22:15 user nova-compute[74540]:   <features>
Nov 07 04:22:15 user nova-compute[74540]:     <acpi/>
Nov 07 04:22:15 user nova-compute[74540]:     <apic/>
Nov 07 04:22:15 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:22:15 user nova-compute[74540]:   </features>
Nov 07 04:22:15 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:22:15 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:22:15 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:22:15 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:22:15 user nova-compute[74540]:   </clock>
Nov 07 04:22:15 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:22:15 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:22:15 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:22:15 user nova-compute[74540]:   </cpu>
Nov 07 04:22:15 user nova-compute[74540]:   <devices>
Nov 07 04:22:15 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:22:15 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:22:15 user nova-compute[74540]:       <source dev="/dev/sdc"/>
Nov 07 04:22:15 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:22:15 user nova-compute[74540]:       <serial>fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948</serial>
Nov 07 04:22:15 user nova-compute[74540]:     </disk>
Nov 07 04:22:15 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:22:15 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:22:15 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.rescue"/>
Nov 07 04:22:15 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 04:22:15 user nova-compute[74540]:       <boot order="1"/>
Nov 07 04:22:15 user nova-compute[74540]:     </disk>
Nov 07 04:22:15 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:22:15 user nova-compute[74540]:       <mac address="fa:16:3e:dc:6c:b2"/>
Nov 07 04:22:15 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:22:15 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:22:15 user nova-compute[74540]:       <target dev="tap5a551def-df"/>
Nov 07 04:22:15 user nova-compute[74540]:     </interface>
Nov 07 04:22:15 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:22:15 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/console.log" append="off"/>
Nov 07 04:22:15 user nova-compute[74540]:     </serial>
Nov 07 04:22:15 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:22:15 user nova-compute[74540]:     <video>
Nov 07 04:22:15 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:22:15 user nova-compute[74540]:     </video>
Nov 07 04:22:15 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:22:15 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:22:15 user nova-compute[74540]:     </rng>
Nov 07 04:22:15 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:22:15 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:22:15 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:22:15 user nova-compute[74540]:     </memballoon>
Nov 07 04:22:15 user nova-compute[74540]:   </devices>
Nov 07 04:22:15 user nova-compute[74540]: </domain>
Nov 07 04:22:15 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:22:15 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Instance destroyed successfully.
Nov 07 04:22:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:22:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] No VIF found with MAC fa:16:3e:dc:6c:b2, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:22:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:16 user nova-compute[74540]: DEBUG nova.compute.manager [req-a1b696f9-62d3-4043-aa3b-fc6ac177be4b req-5746dca0-ed6c-4bc3-af8c-89d49dcedaaf service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:22:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a1b696f9-62d3-4043-aa3b-fc6ac177be4b req-5746dca0-ed6c-4bc3-af8c-89d49dcedaaf service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:22:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a1b696f9-62d3-4043-aa3b-fc6ac177be4b req-5746dca0-ed6c-4bc3-af8c-89d49dcedaaf service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:22:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a1b696f9-62d3-4043-aa3b-fc6ac177be4b req-5746dca0-ed6c-4bc3-af8c-89d49dcedaaf service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:22:16 user nova-compute[74540]: DEBUG nova.compute.manager [req-a1b696f9-62d3-4043-aa3b-fc6ac177be4b req-5746dca0-ed6c-4bc3-af8c-89d49dcedaaf service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:22:16 user nova-compute[74540]: WARNING nova.compute.manager [req-a1b696f9-62d3-4043-aa3b-fc6ac177be4b req-5746dca0-ed6c-4bc3-af8c-89d49dcedaaf service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state active and task_state rescuing.
Nov 07 04:22:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-fd41e0de-c396-49a2-90b1-e0bb42e8f575 req-10763a42-a4ed-458e-aa73-494899ae28d2 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:22:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fd41e0de-c396-49a2-90b1-e0bb42e8f575 req-10763a42-a4ed-458e-aa73-494899ae28d2 service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:22:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fd41e0de-c396-49a2-90b1-e0bb42e8f575 req-10763a42-a4ed-458e-aa73-494899ae28d2 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:22:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fd41e0de-c396-49a2-90b1-e0bb42e8f575 req-10763a42-a4ed-458e-aa73-494899ae28d2 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:22:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-fd41e0de-c396-49a2-90b1-e0bb42e8f575 req-10763a42-a4ed-458e-aa73-494899ae28d2 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:22:19 user nova-compute[74540]: WARNING nova.compute.manager [req-fd41e0de-c396-49a2-90b1-e0bb42e8f575 req-10763a42-a4ed-458e-aa73-494899ae28d2 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state active and task_state rescuing.
Nov 07 04:22:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-ddbc93c5-e54a-464e-bd7b-69f958ad4e75 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:22:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:47 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:51 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 04:22:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] There are 0 instances to clean {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 04:22:52 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:52 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:52 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:22:53 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:54 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:22:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:22:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:22:54 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:22:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:22:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:22:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.rescue --force-share --output=json" returned: 0 in 0.279s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:22:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:22:57 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:22:57 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8224MB free_disk=24.687122344970703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance eab83056-14bd-4dd3-bcd0-7bc25cb8f722 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cfdde86e-1e12-44f3-88d1-ca15a66e03e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance dce42579-e49b-472a-bb91-e6c3365d5553 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing inventories for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating ProviderTree inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing aggregate associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, aggregates: None {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 04:22:57 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing trait associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 04:22:58 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:22:58 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:22:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:22:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:22:58 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:22:58 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74540) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 04:23:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:23:05 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:23:05 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:23:05 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:23:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:23:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:23:05 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:23:05 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid bb6c2f59-c949-4df8-a6e4-ed92d7926639 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:23:05 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updating instance_info_cache with network_info: [{"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:23:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:23:05 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:23:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:23:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:23:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:23:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:23:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid bb6c2f59-c949-4df8-a6e4-ed92d7926639 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid ac4742cd-822a-43b1-adc7-4c7452bd0e35 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid eab83056-14bd-4dd3-bcd0-7bc25cb8f722 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid cfdde86e-1e12-44f3-88d1-ca15a66e03e8 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid dce42579-e49b-472a-bb91-e6c3365d5553 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:23:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:23:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:23:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:23:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:23:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:23:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:23:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:23:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:23:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:23:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:23:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:23:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:23:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:23:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:23:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:23:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:23:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:23:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:23:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:23:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:23:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:38 user nova-compute[74540]: DEBUG nova.compute.manager [req-f8a9532a-ec54-4f02-b0ff-e1e79ccf4d7f req-0c892e10-8e35-4e60-a1f6-94ded8ab8a20 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Received event network-changed-76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:23:38 user nova-compute[74540]: DEBUG nova.compute.manager [req-f8a9532a-ec54-4f02-b0ff-e1e79ccf4d7f req-0c892e10-8e35-4e60-a1f6-94ded8ab8a20 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Refreshing instance network info cache due to event network-changed-76adb4f7-18f1-44d2-8109-fb2f8b05927d. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:23:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8a9532a-ec54-4f02-b0ff-e1e79ccf4d7f req-0c892e10-8e35-4e60-a1f6-94ded8ab8a20 service nova] Acquiring lock "refresh_cache-dce42579-e49b-472a-bb91-e6c3365d5553" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:23:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8a9532a-ec54-4f02-b0ff-e1e79ccf4d7f req-0c892e10-8e35-4e60-a1f6-94ded8ab8a20 service nova] Acquired lock "refresh_cache-dce42579-e49b-472a-bb91-e6c3365d5553" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:23:38 user nova-compute[74540]: DEBUG nova.network.neutron [req-f8a9532a-ec54-4f02-b0ff-e1e79ccf4d7f req-0c892e10-8e35-4e60-a1f6-94ded8ab8a20 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Refreshing network info cache for port 76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:23:39 user nova-compute[74540]: DEBUG nova.network.neutron [req-f8a9532a-ec54-4f02-b0ff-e1e79ccf4d7f req-0c892e10-8e35-4e60-a1f6-94ded8ab8a20 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Updated VIF entry in instance network info cache for port 76adb4f7-18f1-44d2-8109-fb2f8b05927d. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:23:39 user nova-compute[74540]: DEBUG nova.network.neutron [req-f8a9532a-ec54-4f02-b0ff-e1e79ccf4d7f req-0c892e10-8e35-4e60-a1f6-94ded8ab8a20 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Updating instance_info_cache with network_info: [{"id": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "address": "fa:16:3e:e5:a0:97", "network": {"id": "e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-278886072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151659fcbec241f7ae4ecd1516724fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adb4f7-18", "ovs_interfaceid": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:23:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f8a9532a-ec54-4f02-b0ff-e1e79ccf4d7f req-0c892e10-8e35-4e60-a1f6-94ded8ab8a20 service nova] Releasing lock "refresh_cache-dce42579-e49b-472a-bb91-e6c3365d5553" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:23:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:23:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:23:39 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lazy-loading 'flavor' on Instance uuid dce42579-e49b-472a-bb91-e6c3365d5553 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:23:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:23:40 user nova-compute[74540]: INFO nova.compute.manager [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Attaching volume d4e4fe9b-ff25-43b7-986a-6c695115f304 to /dev/vdb
Nov 07 04:23:40 user nova-compute[74540]: DEBUG os_brick.utils [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2597e07a-7b25-41cf-ae1f-1b26e3772976]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed7df46-1b08-466f-8748-7f43f1a5721e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff082a25-2786-423c-91ae-eff2faacadf7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5c26e9-ccb0-4cd0-aceb-3296fb9e3593]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:23:40 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:23:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[978d9f24-1dff-49da-92ab-0f181498e29a]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG os_brick.utils [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:23:40 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Updating existing volume attachment record: 4ef3e0ca-cb7f-4003-99c7-4d19b98946c2 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:23:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:47 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:23:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:23:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:23:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:23:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:23:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:23:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:23:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:51 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:23:52 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:23:53 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:23:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:23:54 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:23:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:23:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:23:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:23:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:23:55 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:23:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:23:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:23:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.rescue --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:23:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:23:58 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:23:58 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:23:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8373MB free_disk=24.67593765258789GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance eab83056-14bd-4dd3-bcd0-7bc25cb8f722 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cfdde86e-1e12-44f3-88d1-ca15a66e03e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance dce42579-e49b-472a-bb91-e6c3365d5553 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:23:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:24:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:24:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:24:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:24:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:24:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:01 user nova-compute[74540]: INFO nova.compute.manager [None req-82aa1b5e-1f6a-42e9-ade6-7eadb69be2cb tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Unrescuing
Nov 07 04:24:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-82aa1b5e-1f6a-42e9-ade6-7eadb69be2cb tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "refresh_cache-cfdde86e-1e12-44f3-88d1-ca15a66e03e8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:24:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-82aa1b5e-1f6a-42e9-ade6-7eadb69be2cb tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquired lock "refresh_cache-cfdde86e-1e12-44f3-88d1-ca15a66e03e8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:24:01 user nova-compute[74540]: DEBUG nova.network.neutron [None req-82aa1b5e-1f6a-42e9-ade6-7eadb69be2cb tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG nova.network.neutron [None req-82aa1b5e-1f6a-42e9-ade6-7eadb69be2cb tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Updating instance_info_cache with network_info: [{"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-82aa1b5e-1f6a-42e9-ade6-7eadb69be2cb tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Releasing lock "refresh_cache-cfdde86e-1e12-44f3-88d1-ca15a66e03e8" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG nova.objects.instance [None req-82aa1b5e-1f6a-42e9-ade6-7eadb69be2cb tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'flavor' on Instance uuid cfdde86e-1e12-44f3-88d1-ca15a66e03e8 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-8a1f73b5-c973-4b31-a946-2521e7b73f97 req-913cb65f-2380-4ce4-a2f8-ce9cd034ac73 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-unplugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8a1f73b5-c973-4b31-a946-2521e7b73f97 req-913cb65f-2380-4ce4-a2f8-ce9cd034ac73 service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8a1f73b5-c973-4b31-a946-2521e7b73f97 req-913cb65f-2380-4ce4-a2f8-ce9cd034ac73 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8a1f73b5-c973-4b31-a946-2521e7b73f97 req-913cb65f-2380-4ce4-a2f8-ce9cd034ac73 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG nova.compute.manager [req-8a1f73b5-c973-4b31-a946-2521e7b73f97 req-913cb65f-2380-4ce4-a2f8-ce9cd034ac73 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-unplugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:24:02 user nova-compute[74540]: WARNING nova.compute.manager [req-8a1f73b5-c973-4b31-a946-2521e7b73f97 req-913cb65f-2380-4ce4-a2f8-ce9cd034ac73 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-unplugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:24:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hsWQgOpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:24:02 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:24:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:24:02 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:24:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:24:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:24:02 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cdc80b-67a9-4176-982f-45a06fed1ce1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:24:03 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[32941b87-d4be-47cf-b453-4145b80007f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304] added
Nov 07 04:24:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.048s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff35bb5-1f9c-41b8-b0cb-10a197951552]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.078s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4e9a75-a707-4b0c-b5e7-7d399aa8004a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hsWQgOpm {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hsWQgOpm" returned: 0 in 0.072s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d79261-816c-4b18-8104-e2336e0593fa]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hsWQgOpm'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5c85f2-22d3-4d4e-8cea-f919faff3a6c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2834a5ea-0013-43c1-a0c2-130a5d69acb4]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:24:03 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:24:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:24:03 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:24:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:03 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Instance destroyed successfully.
Nov 07 04:24:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a708d3f8-e289-416a-a700-1cbbb3506854]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304, portal: 172.16.0.220,3260]
Nov 07 04:24:03 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304, portal: 172.16.0.220,3260] successful.
Nov 07 04:24:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eb93af-c1c4-4d5b-a36d-ef3ee6418318]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7405126-e722-4a0a-bb3d-cb50703786a8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:24:03 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:24:03 user nova-compute[74540]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)
Nov 07 04:24:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:24:03 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:24:03 user nova-compute[74540]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)
Nov 07 04:24:03 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.576s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8599a20-b452-4bce-b074-13e9b9591420]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:24:03 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hsWQgOpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.612s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] <== connect_volume: return (1615ms) {'type': 'block', 'scsi_wwn': '26562633633623132', 'path': '/dev/sdd'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562633633623132', 'path': '/dev/sdd'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lazy-loading 'flavor' on Instance uuid dce42579-e49b-472a-bb91-e6c3365d5553 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:24:04 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:24:04 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:24:04 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:24:04 user nova-compute[74540]:   <serial>d4e4fe9b-ff25-43b7-986a-6c695115f304</serial>
Nov 07 04:24:04 user nova-compute[74540]: </disk>
Nov 07 04:24:04 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-7c841f3d-a889-49ca-abbf-40fbe01de938 req-d0876a83-9f60-43b5-a935-eb31efc32fe7 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7c841f3d-a889-49ca-abbf-40fbe01de938 req-d0876a83-9f60-43b5-a935-eb31efc32fe7 service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7c841f3d-a889-49ca-abbf-40fbe01de938 req-d0876a83-9f60-43b5-a935-eb31efc32fe7 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7c841f3d-a889-49ca-abbf-40fbe01de938 req-d0876a83-9f60-43b5-a935-eb31efc32fe7 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-7c841f3d-a889-49ca-abbf-40fbe01de938 req-d0876a83-9f60-43b5-a935-eb31efc32fe7 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:24:04 user nova-compute[74540]: WARNING nova.compute.manager [req-7c841f3d-a889-49ca-abbf-40fbe01de938 req-d0876a83-9f60-43b5-a935-eb31efc32fe7 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:24:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:24:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:24:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] No VIF found with MAC fa:16:3e:e5:a0:97, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:24:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ec3dd00c-b241-4dec-b094-359084ee3a21 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.328s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:06 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Updating instance_info_cache with network_info: [{"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:24:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-ac4742cd-822a-43b1-adc7-4c7452bd0e35" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:24:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:24:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-0dd9e6ff-30a1-4595-97a8-5f7df976c605 req-4a803dcb-ab3e-4d53-ba78-cebb015c7fdd service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:24:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0dd9e6ff-30a1-4595-97a8-5f7df976c605 req-4a803dcb-ab3e-4d53-ba78-cebb015c7fdd service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0dd9e6ff-30a1-4595-97a8-5f7df976c605 req-4a803dcb-ab3e-4d53-ba78-cebb015c7fdd service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0dd9e6ff-30a1-4595-97a8-5f7df976c605 req-4a803dcb-ab3e-4d53-ba78-cebb015c7fdd service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-0dd9e6ff-30a1-4595-97a8-5f7df976c605 req-4a803dcb-ab3e-4d53-ba78-cebb015c7fdd service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:24:07 user nova-compute[74540]: WARNING nova.compute.manager [req-0dd9e6ff-30a1-4595-97a8-5f7df976c605 req-4a803dcb-ab3e-4d53-ba78-cebb015c7fdd service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:24:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-0dd9e6ff-30a1-4595-97a8-5f7df976c605 req-4a803dcb-ab3e-4d53-ba78-cebb015c7fdd service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:24:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0dd9e6ff-30a1-4595-97a8-5f7df976c605 req-4a803dcb-ab3e-4d53-ba78-cebb015c7fdd service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0dd9e6ff-30a1-4595-97a8-5f7df976c605 req-4a803dcb-ab3e-4d53-ba78-cebb015c7fdd service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0dd9e6ff-30a1-4595-97a8-5f7df976c605 req-4a803dcb-ab3e-4d53-ba78-cebb015c7fdd service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-0dd9e6ff-30a1-4595-97a8-5f7df976c605 req-4a803dcb-ab3e-4d53-ba78-cebb015c7fdd service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:24:07 user nova-compute[74540]: WARNING nova.compute.manager [req-0dd9e6ff-30a1-4595-97a8-5f7df976c605 req-4a803dcb-ab3e-4d53-ba78-cebb015c7fdd service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state rescued and task_state unrescuing.
Nov 07 04:24:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-82aa1b5e-1f6a-42e9-ade6-7eadb69be2cb tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:24:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:09 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lazy-loading 'flavor' on Instance uuid dce42579-e49b-472a-bb91-e6c3365d5553 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:24:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:10 user nova-compute[74540]: INFO nova.compute.manager [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Attaching volume 52ef35c5-8e31-4fbf-86b8-33ed30a7e279 to /dev/vdc
Nov 07 04:24:10 user nova-compute[74540]: DEBUG os_brick.utils [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c69434-4bf0-4506-815f-352b5d94846a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c28f35f-f712-4350-bd0e-2336c48114e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c287473-1e1e-4ef8-8644-3e0f5069a596]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c672ff-07ae-4c50-b41d-fa73f9e3b2db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:24:10 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:24:10 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[935d419e-bbe6-439d-bd32-e9033ba43f7d]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG os_brick.utils [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:24:10 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Updating existing volume attachment record: f3f7cd2d-be10-449e-93f7-258ed6767950 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:24:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:24:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:24:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:24:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:24:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:35 user nova-compute[74540]: INFO nova.compute.manager [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Terminating instance
Nov 07 04:24:35 user nova-compute[74540]: DEBUG nova.compute.manager [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUZVGOYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:24:35 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:24:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:24:35 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:24:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:24:35 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb9029-2d42-4210-8215-abbd76e7a85e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:24:35 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa72e99-8811-48da-84ed-4cb57d58aae3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279] added
Nov 07 04:24:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3d844f-bcde-421a-9778-2c6e63fd990c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d245c9df-af39-4d50-8e53-0c13e8e4d0d1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XUZVGOYS {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XUZVGOYS" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cbb489-cae8-454a-875e-e7cc958eb0ae]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XUZVGOYS'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.compute.manager [req-ac33fabd-bb17-4d6f-82ed-7d07824f2cfe req-3b9782d0-a4f4-46d0-8e3f-8c1f9e7df228 service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Received event network-vif-unplugged-9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ac33fabd-bb17-4d6f-82ed-7d07824f2cfe req-3b9782d0-a4f4-46d0-8e3f-8c1f9e7df228 service nova] Acquiring lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ac33fabd-bb17-4d6f-82ed-7d07824f2cfe req-3b9782d0-a4f4-46d0-8e3f-8c1f9e7df228 service nova] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ac33fabd-bb17-4d6f-82ed-7d07824f2cfe req-3b9782d0-a4f4-46d0-8e3f-8c1f9e7df228 service nova] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.compute.manager [req-ac33fabd-bb17-4d6f-82ed-7d07824f2cfe req-3b9782d0-a4f4-46d0-8e3f-8c1f9e7df228 service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] No waiting events found dispatching network-vif-unplugged-9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.compute.manager [req-ac33fabd-bb17-4d6f-82ed-7d07824f2cfe req-3b9782d0-a4f4-46d0-8e3f-8c1f9e7df228 service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Received event network-vif-unplugged-9635f951-17ba-47fc-91d9-105fca414382 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f64037d-adcb-4aae-a85f-1d478cfe02ea]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f22cd65-4e4c-409e-bfae-a1a4c2573d65]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18d6dbc-78c0-44bb-99e8-d9cfa2ba8dd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279, portal: 172.16.0.220,3260]
Nov 07 04:24:36 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279, portal: 172.16.0.220,3260] successful.
Nov 07 04:24:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:36 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Instance destroyed successfully.
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.objects.instance [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lazy-loading 'resources' on Instance uuid eab83056-14bd-4dd3-bcd0-7bc25cb8f722 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f30ca5-114e-4205-b716-9b553dea7f39]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:15:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-478997355',display_name='tempest-ServersNegativeTestJSON-server-478997355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-478997355',id=34,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8c4c299b1b74a68a93a3f373067051f',ramdisk_id='',reservation_id='r-qvk0voe4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-640893805',owner_user_name='tempest-ServersNegativeTestJSON-640893805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:15:27Z,user_data=None,user_id='8b1fde560d4146e48532693afb044a41',uuid=eab83056-14bd-4dd3-bcd0-7bc25cb8f722,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9635f951-17ba-47fc-91d9-105fca414382", "address": "fa:16:3e:74:86:27", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9635f951-17", "ovs_interfaceid": "9635f951-17ba-47fc-91d9-105fca414382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Converting VIF {"id": "9635f951-17ba-47fc-91d9-105fca414382", "address": "fa:16:3e:74:86:27", "network": {"id": "1f0b6d80-098f-47c8-b5aa-c57dd395f2c4", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1485479784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8c4c299b1b74a68a93a3f373067051f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9635f951-17", "ovs_interfaceid": "9635f951-17ba-47fc-91d9-105fca414382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:86:27,bridge_name='br-int',has_traffic_filtering=True,id=9635f951-17ba-47fc-91d9-105fca414382,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9635f951-17') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_vif [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:86:27,bridge_name='br-int',has_traffic_filtering=True,id=9635f951-17ba-47fc-91d9-105fca414382,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9635f951-17') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9635f951-17, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0ac4fa9-10e9-409f-bf52-302d763dcec4) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:36 user nova-compute[74540]: INFO os_vif [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:86:27,bridge_name='br-int',has_traffic_filtering=True,id=9635f951-17ba-47fc-91d9-105fca414382,network=Network(1f0b6d80-098f-47c8-b5aa-c57dd395f2c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9635f951-17')
Nov 07 04:24:36 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Deleting instance files /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722_del
Nov 07 04:24:36 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Deletion of /opt/stack/data/nova/instances/eab83056-14bd-4dd3-bcd0-7bc25cb8f722_del complete
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6223f6f7-b638-429f-8db3-543d3027616b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 (non-flash)
Nov 07 04:24:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[975b1bff-c8f5-44fb-a114-9b14f85330a2]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:24:36 user nova-compute[74540]: INFO nova.compute.claims [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Claim successful on node user
Nov 07 04:24:36 user nova-compute[74540]: INFO nova.compute.manager [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:24:36 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:24:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:24:37 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Creating image(s)
Nov 07 04:24:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "/opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "/opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "0ae478179083b1cf024a5a48c74b1b419b911a9f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "0ae478179083b1cf024a5a48c74b1b419b911a9f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG nova.policy [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48997d7730cb406dbf7d127224a52543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bc5f60b66347ca8404e1553ec719d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:24:37 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Took 0.81 seconds to deallocate network for instance.
Nov 07 04:24:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-452fec61-6de1-4286-ad03-3c32d47672c8 req-9db006b7-e716-40ee-8ca3-7e9af5da449e service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Received event network-vif-deleted-9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:24:37 user nova-compute[74540]: INFO nova.compute.manager [req-452fec61-6de1-4286-ad03-3c32d47672c8 req-9db006b7-e716-40ee-8ca3-7e9af5da449e service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Neutron deleted interface 9635f951-17ba-47fc-91d9-105fca414382; detaching it from the instance and deleting it from the info cache
Nov 07 04:24:37 user nova-compute[74540]: DEBUG nova.network.neutron [req-452fec61-6de1-4286-ad03-3c32d47672c8 req-9db006b7-e716-40ee-8ca3-7e9af5da449e service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f.part --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUZVGOYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.827s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] <== connect_volume: return (1831ms) {'type': 'block', 'scsi_wwn': '23331336339376266', 'path': '/dev/sde'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331336339376266', 'path': '/dev/sde'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-452fec61-6de1-4286-ad03-3c32d47672c8 req-9db006b7-e716-40ee-8ca3-7e9af5da449e service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Detach interface failed, port_id=9635f951-17ba-47fc-91d9-105fca414382, reason: Instance eab83056-14bd-4dd3-bcd0-7bc25cb8f722 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lazy-loading 'flavor' on Instance uuid dce42579-e49b-472a-bb91-e6c3365d5553 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:24:37 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:24:37 user nova-compute[74540]:   <source dev="/dev/sde"/>
Nov 07 04:24:37 user nova-compute[74540]:   <target dev="vdc" bus="virtio"/>
Nov 07 04:24:37 user nova-compute[74540]:   <serial>52ef35c5-8e31-4fbf-86b8-33ed30a7e279</serial>
Nov 07 04:24:37 user nova-compute[74540]: </disk>
Nov 07 04:24:37 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f.part --force-share --output=json" returned: 0 in 0.194s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG nova.virt.images [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] b4dd7e24-5719-46fc-be3b-c2b15e7a318a was qcow2, converting to raw {{(pid=74540) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:24:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f.part /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f.converted {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG nova.compute.manager [req-74dad0d6-08e4-4016-9f0d-c25445784e64 req-abce5c2d-b94e-4838-9af5-a5dc422d3df9 service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Received event network-vif-plugged-9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-74dad0d6-08e4-4016-9f0d-c25445784e64 req-abce5c2d-b94e-4838-9af5-a5dc422d3df9 service nova] Acquiring lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-74dad0d6-08e4-4016-9f0d-c25445784e64 req-abce5c2d-b94e-4838-9af5-a5dc422d3df9 service nova] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-74dad0d6-08e4-4016-9f0d-c25445784e64 req-abce5c2d-b94e-4838-9af5-a5dc422d3df9 service nova] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG nova.compute.manager [req-74dad0d6-08e4-4016-9f0d-c25445784e64 req-abce5c2d-b94e-4838-9af5-a5dc422d3df9 service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] No waiting events found dispatching network-vif-plugged-9635f951-17ba-47fc-91d9-105fca414382 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:24:38 user nova-compute[74540]: WARNING nova.compute.manager [req-74dad0d6-08e4-4016-9f0d-c25445784e64 req-abce5c2d-b94e-4838-9af5-a5dc422d3df9 service nova] [instance: eab83056-14bd-4dd3-bcd0-7bc25cb8f722] Received unexpected event network-vif-plugged-9635f951-17ba-47fc-91d9-105fca414382 for instance with vm_state deleted and task_state None.
Nov 07 04:24:38 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Successfully created port: 356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] No VIF found with MAC fa:16:3e:e5:a0:97, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f.part /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f.converted" returned: 0 in 0.511s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f.converted --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.711s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:38 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Deleted allocations for instance eab83056-14bd-4dd3-bcd0-7bc25cb8f722
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f4d8cdc9-dccb-4e0a-ae8b-cb08f6f9138b tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.412s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "0ae478179083b1cf024a5a48c74b1b419b911a9f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.413s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9e23701c-ab03-473d-b359-b337851e55eb tempest-ServersNegativeTestJSON-640893805 tempest-ServersNegativeTestJSON-640893805-project-member] Lock "eab83056-14bd-4dd3-bcd0-7bc25cb8f722" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.257s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "0ae478179083b1cf024a5a48c74b1b419b911a9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "0ae478179083b1cf024a5a48c74b1b419b911a9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f,backing_fmt=raw /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f,backing_fmt=raw /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk 1073741824" returned: 0 in 0.050s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "0ae478179083b1cf024a5a48c74b1b419b911a9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Successfully updated port: 356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquired lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Cannot resize image /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Ensure instance console log exists: /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-cfab137c-4194-49fa-9701-93c9c0ca81ff req-37ccb076-8a94-4b83-a9e2-c2e5df84218c service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-changed-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-cfab137c-4194-49fa-9701-93c9c0ca81ff req-37ccb076-8a94-4b83-a9e2-c2e5df84218c service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Refreshing instance network info cache due to event network-changed-356a2bea-a767-4948-b7f5-3f1871db48f0. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-cfab137c-4194-49fa-9701-93c9c0ca81ff req-37ccb076-8a94-4b83-a9e2-c2e5df84218c service nova] Acquiring lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.network.neutron [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updating instance_info_cache with network_info: [{"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Releasing lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Instance network_info: |[{"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-cfab137c-4194-49fa-9701-93c9c0ca81ff req-37ccb076-8a94-4b83-a9e2-c2e5df84218c service nova] Acquired lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.network.neutron [req-cfab137c-4194-49fa-9701-93c9c0ca81ff req-37ccb076-8a94-4b83-a9e2-c2e5df84218c service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Refreshing network info cache for port 356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Start _get_guest_xml network_info=[{"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T04:24:32Z,direct_url=<?>,disk_format='qcow2',id=b4dd7e24-5719-46fc-be3b-c2b15e7a318a,min_disk=0,min_ram=0,name='tempest-scenario-img--845804453',owner='92bc5f60b66347ca8404e1553ec719d7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T04:24:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b4dd7e24-5719-46fc-be3b-c2b15e7a318a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:24:39 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:24:39 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T04:24:32Z,direct_url=<?>,disk_format='qcow2',id=b4dd7e24-5719-46fc-be3b-c2b15e7a318a,min_disk=0,min_ram=0,name='tempest-scenario-img--845804453',owner='92bc5f60b66347ca8404e1553ec719d7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T04:24:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1823291217',display_name='tempest-TestMinimumBasicScenario-server-1823291217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1823291217',id=41,image_ref='b4dd7e24-5719-46fc-be3b-c2b15e7a318a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZ5g6Rw23CRhXshdRlt3kBkQr87DRjsdcdtrFVqa3XSLXtWNb0bH/ZdAzkAy0kffcjbYZ+/V+DIhpBa4kXn4wMwWewFeUAaDJqnWuMnJb2JgVCLnX36JI+9j7zR3ryXcw==',key_name='tempest-TestMinimumBasicScenario-872081033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bc5f60b66347ca8404e1553ec719d7',ramdisk_id='',reservation_id='r-rw8uyp2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dd7e24-5719-46fc-be3b-c2b15e7a318a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-702707071',owner_user_name='tempest-TestMinimumBasicScenario-702707071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:24:37Z,user_data=None,user_id='48997d7730cb406dbf7d127224a52543',uuid=7ea40dee-8c35-4508-a8c1-34772281aa15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converting VIF {"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.objects.instance [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ea40dee-8c35-4508-a8c1-34772281aa15 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:24:39 user nova-compute[74540]:   <uuid>7ea40dee-8c35-4508-a8c1-34772281aa15</uuid>
Nov 07 04:24:39 user nova-compute[74540]:   <name>instance-00000029</name>
Nov 07 04:24:39 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:24:39 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:24:39 user nova-compute[74540]:   <metadata>
Nov 07 04:24:39 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:24:39 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:24:39 user nova-compute[74540]:       <nova:name>tempest-TestMinimumBasicScenario-server-1823291217</nova:name>
Nov 07 04:24:39 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:24:39</nova:creationTime>
Nov 07 04:24:39 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:24:39 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:24:39 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:24:39 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:24:39 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:24:39 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:24:39 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:24:39 user nova-compute[74540]:       <nova:owner>
Nov 07 04:24:39 user nova-compute[74540]:         <nova:user uuid="48997d7730cb406dbf7d127224a52543">tempest-TestMinimumBasicScenario-702707071-project-member</nova:user>
Nov 07 04:24:39 user nova-compute[74540]:         <nova:project uuid="92bc5f60b66347ca8404e1553ec719d7">tempest-TestMinimumBasicScenario-702707071</nova:project>
Nov 07 04:24:39 user nova-compute[74540]:       </nova:owner>
Nov 07 04:24:39 user nova-compute[74540]:       <nova:root type="image" uuid="b4dd7e24-5719-46fc-be3b-c2b15e7a318a"/>
Nov 07 04:24:39 user nova-compute[74540]:       <nova:ports>
Nov 07 04:24:39 user nova-compute[74540]:         <nova:port uuid="356a2bea-a767-4948-b7f5-3f1871db48f0">
Nov 07 04:24:39 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 04:24:39 user nova-compute[74540]:         </nova:port>
Nov 07 04:24:39 user nova-compute[74540]:       </nova:ports>
Nov 07 04:24:39 user nova-compute[74540]:     </nova:instance>
Nov 07 04:24:39 user nova-compute[74540]:   </metadata>
Nov 07 04:24:39 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:24:39 user nova-compute[74540]:     <system>
Nov 07 04:24:39 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:24:39 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:24:39 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:24:39 user nova-compute[74540]:       <entry name="serial">7ea40dee-8c35-4508-a8c1-34772281aa15</entry>
Nov 07 04:24:39 user nova-compute[74540]:       <entry name="uuid">7ea40dee-8c35-4508-a8c1-34772281aa15</entry>
Nov 07 04:24:39 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:24:39 user nova-compute[74540]:     </system>
Nov 07 04:24:39 user nova-compute[74540]:   </sysinfo>
Nov 07 04:24:39 user nova-compute[74540]:   <os>
Nov 07 04:24:39 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:24:39 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:24:39 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:24:39 user nova-compute[74540]:   </os>
Nov 07 04:24:39 user nova-compute[74540]:   <features>
Nov 07 04:24:39 user nova-compute[74540]:     <acpi/>
Nov 07 04:24:39 user nova-compute[74540]:     <apic/>
Nov 07 04:24:39 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:24:39 user nova-compute[74540]:   </features>
Nov 07 04:24:39 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:24:39 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:24:39 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:24:39 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:24:39 user nova-compute[74540]:   </clock>
Nov 07 04:24:39 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:24:39 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:24:39 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:24:39 user nova-compute[74540]:   </cpu>
Nov 07 04:24:39 user nova-compute[74540]:   <devices>
Nov 07 04:24:39 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:24:39 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:24:39 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk"/>
Nov 07 04:24:39 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:24:39 user nova-compute[74540]:     </disk>
Nov 07 04:24:39 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:24:39 user nova-compute[74540]:       <mac address="fa:16:3e:52:b2:6e"/>
Nov 07 04:24:39 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:24:39 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:24:39 user nova-compute[74540]:       <target dev="tap356a2bea-a7"/>
Nov 07 04:24:39 user nova-compute[74540]:     </interface>
Nov 07 04:24:39 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:24:39 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/console.log" append="off"/>
Nov 07 04:24:39 user nova-compute[74540]:     </serial>
Nov 07 04:24:39 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:24:39 user nova-compute[74540]:     <video>
Nov 07 04:24:39 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:24:39 user nova-compute[74540]:     </video>
Nov 07 04:24:39 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:24:39 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:24:39 user nova-compute[74540]:     </rng>
Nov 07 04:24:39 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:24:39 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:24:39 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:24:39 user nova-compute[74540]:     </memballoon>
Nov 07 04:24:39 user nova-compute[74540]:   </devices>
Nov 07 04:24:39 user nova-compute[74540]: </domain>
Nov 07 04:24:39 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1823291217',display_name='tempest-TestMinimumBasicScenario-server-1823291217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1823291217',id=41,image_ref='b4dd7e24-5719-46fc-be3b-c2b15e7a318a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZ5g6Rw23CRhXshdRlt3kBkQr87DRjsdcdtrFVqa3XSLXtWNb0bH/ZdAzkAy0kffcjbYZ+/V+DIhpBa4kXn4wMwWewFeUAaDJqnWuMnJb2JgVCLnX36JI+9j7zR3ryXcw==',key_name='tempest-TestMinimumBasicScenario-872081033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bc5f60b66347ca8404e1553ec719d7',ramdisk_id='',reservation_id='r-rw8uyp2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dd7e24-5719-46fc-be3b-c2b15e7a318a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-702707071',owner_user_name='tempest-TestMinimumBasicScenario-702707071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:24:37Z,user_data=None,user_id='48997d7730cb406dbf7d127224a52543',uuid=7ea40dee-8c35-4508-a8c1-34772281aa15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converting VIF {"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG os_vif [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9105a4c4-d243-5379-ab28-f47170a2ee33', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap356a2bea-a7, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap356a2bea-a7, col_values=(('qos', UUID('4ccfae99-971d-42aa-a317-743fc6501f82')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap356a2bea-a7, col_values=(('external_ids', {'iface-id': '356a2bea-a767-4948-b7f5-3f1871db48f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:b2:6e', 'vm-uuid': '7ea40dee-8c35-4508-a8c1-34772281aa15'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:39 user nova-compute[74540]: INFO os_vif [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7')
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:24:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] No VIF found with MAC fa:16:3e:52:b2:6e, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:24:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:40 user nova-compute[74540]: INFO nova.compute.manager [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Detaching volume 52ef35c5-8e31-4fbf-86b8-33ed30a7e279
Nov 07 04:24:40 user nova-compute[74540]: INFO nova.virt.block_device [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Attempting to driver detach volume 52ef35c5-8e31-4fbf-86b8-33ed30a7e279 from mountpoint /dev/vdc
Nov 07 04:24:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Attempting to detach device vdc from instance dce42579-e49b-472a-bb91-e6c3365d5553 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:24:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:24:40 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:24:40 user nova-compute[74540]:   <source dev="/dev/sde"/>
Nov 07 04:24:40 user nova-compute[74540]:   <target dev="vdc" bus="virtio"/>
Nov 07 04:24:40 user nova-compute[74540]:   <serial>52ef35c5-8e31-4fbf-86b8-33ed30a7e279</serial>
Nov 07 04:24:40 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 07 04:24:40 user nova-compute[74540]: </disk>
Nov 07 04:24:40 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:24:40 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Successfully detached device vdc from instance dce42579-e49b-472a-bb91-e6c3365d5553 from the persistent domain config.
Nov 07 04:24:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance dce42579-e49b-472a-bb91-e6c3365d5553 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:24:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:24:40 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:24:40 user nova-compute[74540]:   <source dev="/dev/sde"/>
Nov 07 04:24:40 user nova-compute[74540]:   <target dev="vdc" bus="virtio"/>
Nov 07 04:24:40 user nova-compute[74540]:   <serial>52ef35c5-8e31-4fbf-86b8-33ed30a7e279</serial>
Nov 07 04:24:40 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 07 04:24:40 user nova-compute[74540]: </disk>
Nov 07 04:24:40 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:24:40 user nova-compute[74540]: DEBUG nova.network.neutron [req-cfab137c-4194-49fa-9701-93c9c0ca81ff req-37ccb076-8a94-4b83-a9e2-c2e5df84218c service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updated VIF entry in instance network info cache for port 356a2bea-a767-4948-b7f5-3f1871db48f0. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:24:40 user nova-compute[74540]: DEBUG nova.network.neutron [req-cfab137c-4194-49fa-9701-93c9c0ca81ff req-37ccb076-8a94-4b83-a9e2-c2e5df84218c service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updating instance_info_cache with network_info: [{"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:24:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-cfab137c-4194-49fa-9701-93c9c0ca81ff req-37ccb076-8a94-4b83-a9e2-c2e5df84218c service nova] Releasing lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:24:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance dce42579-e49b-472a-bb91-e6c3365d5553 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:24:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-1da24c81-c5cd-42c0-8639-745ca35edd3c req-7fde95b9-4d93-4153-843e-27ebe6b3ab23 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:24:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1da24c81-c5cd-42c0-8639-745ca35edd3c req-7fde95b9-4d93-4153-843e-27ebe6b3ab23 service nova] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1da24c81-c5cd-42c0-8639-745ca35edd3c req-7fde95b9-4d93-4153-843e-27ebe6b3ab23 service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1da24c81-c5cd-42c0-8639-745ca35edd3c req-7fde95b9-4d93-4153-843e-27ebe6b3ab23 service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-1da24c81-c5cd-42c0-8639-745ca35edd3c req-7fde95b9-4d93-4153-843e-27ebe6b3ab23 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] No waiting events found dispatching network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:24:41 user nova-compute[74540]: WARNING nova.compute.manager [req-1da24c81-c5cd-42c0-8639-745ca35edd3c req-7fde95b9-4d93-4153-843e-27ebe6b3ab23 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received unexpected event network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 for instance with vm_state building and task_state spawning.
Nov 07 04:24:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:24:43 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Instance spawned successfully.
Nov 07 04:24:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-eb20ad20-43a3-4245-991d-386db7cf7689 req-89a99c70-731f-45a8-81c6-d9ff3a4044df service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-eb20ad20-43a3-4245-991d-386db7cf7689 req-89a99c70-731f-45a8-81c6-d9ff3a4044df service nova] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-eb20ad20-43a3-4245-991d-386db7cf7689 req-89a99c70-731f-45a8-81c6-d9ff3a4044df service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-eb20ad20-43a3-4245-991d-386db7cf7689 req-89a99c70-731f-45a8-81c6-d9ff3a4044df service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-eb20ad20-43a3-4245-991d-386db7cf7689 req-89a99c70-731f-45a8-81c6-d9ff3a4044df service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] No waiting events found dispatching network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:24:43 user nova-compute[74540]: WARNING nova.compute.manager [req-eb20ad20-43a3-4245-991d-386db7cf7689 req-89a99c70-731f-45a8-81c6-d9ff3a4044df service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received unexpected event network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 for instance with vm_state building and task_state spawning.
Nov 07 04:24:43 user nova-compute[74540]: INFO nova.compute.manager [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 07 04:24:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:24:44 user nova-compute[74540]: INFO nova.compute.manager [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Took 7.77 seconds to build instance.
Nov 07 04:24:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-8afe7cd9-4a71-4467-90ee-9d98d6b8856b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.904s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:24:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:24:49 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:24:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:52 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:24:53 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:24:53 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:24:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:24:54 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:24:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:24:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:24:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:24:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:24:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:56 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:24:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:24:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:24:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:24:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:24:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:24:58 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:24:58 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:24:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8273MB free_disk=24.630950927734375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:24:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cfdde86e-1e12-44f3-88d1-ca15a66e03e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance dce42579-e49b-472a-bb91-e6c3365d5553 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 7ea40dee-8c35-4508-a8c1-34772281aa15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:24:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:00 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance dce42579-e49b-472a-bb91-e6c3365d5553 is timed out.
Nov 07 04:25:00 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Successfully detached device vdc from instance dce42579-e49b-472a-bb91-e6c3365d5553 from the live domain config.
Nov 07 04:25:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:25:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XUZVGOYS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:25:00 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:25:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:25:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:25:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3800218d-7ae7-4ef8-9fb0-29dffef01e1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:25:00 user nova-compute[74540]: No targets found.
Nov 07 04:25:00 user nova-compute[74540]: iSNS:
Nov 07 04:25:00 user nova-compute[74540]: No targets found.
Nov 07 04:25:00 user nova-compute[74540]: STATIC:
Nov 07 04:25:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304
Nov 07 04:25:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:25:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:25:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948
Nov 07 04:25:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:25:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:25:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:25:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:25:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:25:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279
Nov 07 04:25:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:25:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:25:00 user nova-compute[74540]: FIRMWARE:
Nov 07 04:25:00 user nova-compute[74540]: No targets found.
Nov 07 04:25:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:25:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:25:00 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:25:00 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:25:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:25:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbc4c94-98dd-4eb4-9acf-9615112b0e28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3154439-51d1-453a-8bbe-249b970f307a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:25:01 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:25:01 user nova-compute[74540]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)
Nov 07 04:25:01 user nova-compute[74540]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 (non-flash)
Nov 07 04:25:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:25:01 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:25:01 user nova-compute[74540]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)
Nov 07 04:25:01 user nova-compute[74540]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 (non-flash)
Nov 07 04:25:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc767250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279'): ({'sde'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Removing single pathed devices sde {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb27c9dc-7c7e-443d-8289-e1261a00f2f0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddd53bc-48cc-4c4a-9274-f75638ea9662]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Flushing IO for device /dev/sde {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aa1c8f-8768-48e9-8a2a-c484d521cdde]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[86007b8f-b206-4a21-968d-26c19b78dd9d]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] SCSI volumes sde have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca203dd-f46d-4a6f-a8c9-e3accf07765a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[80721b2b-f1d8-4f58-a746-d0a48e7983b7]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279, portal: 172.16.0.220,3260]
Nov 07 04:25:01 user nova-compute[74540]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279, portal: 172.16.0.220,3260] successful.
Nov 07 04:25:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52ef35c5-8e31-4fbf-86b8-33ed30a7e279 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[883ec4d9-5094-4b2c-864e-535733102d4d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] <== disconnect_volume: return (324ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:25:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:02 user nova-compute[74540]: DEBUG nova.objects.instance [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lazy-loading 'flavor' on Instance uuid dce42579-e49b-472a-bb91-e6c3365d5553 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:25:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-de49855c-0650-4a9d-92c1-efd40edde794 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.248s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:25:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:06 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:25:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:25:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-47f331c2-4e12-45cc-8b9d-a566a0dbbca1" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:25:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-47f331c2-4e12-45cc-8b9d-a566a0dbbca1" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:25:06 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:25:06 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Updating instance_info_cache with network_info: [{"id": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "address": "fa:16:3e:95:b2:60", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b9d20a-b1", "ovs_interfaceid": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:25:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-47f331c2-4e12-45cc-8b9d-a566a0dbbca1" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:25:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:25:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:25:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:25:30 user nova-compute[74540]: INFO nova.compute.manager [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Detaching volume d4e4fe9b-ff25-43b7-986a-6c695115f304
Nov 07 04:25:30 user nova-compute[74540]: INFO nova.virt.block_device [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Attempting to driver detach volume d4e4fe9b-ff25-43b7-986a-6c695115f304 from mountpoint /dev/vdb
Nov 07 04:25:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Attempting to detach device vdb from instance dce42579-e49b-472a-bb91-e6c3365d5553 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:25:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:25:30 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:25:30 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:25:30 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:25:30 user nova-compute[74540]:   <serial>d4e4fe9b-ff25-43b7-986a-6c695115f304</serial>
Nov 07 04:25:30 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:25:30 user nova-compute[74540]: </disk>
Nov 07 04:25:30 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:25:30 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Successfully detached device vdb from instance dce42579-e49b-472a-bb91-e6c3365d5553 from the persistent domain config.
Nov 07 04:25:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dce42579-e49b-472a-bb91-e6c3365d5553 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:25:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:25:30 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:25:30 user nova-compute[74540]:   <source dev="/dev/sdd"/>
Nov 07 04:25:30 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:25:30 user nova-compute[74540]:   <serial>d4e4fe9b-ff25-43b7-986a-6c695115f304</serial>
Nov 07 04:25:30 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:25:30 user nova-compute[74540]: </disk>
Nov 07 04:25:30 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:25:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dce42579-e49b-472a-bb91-e6c3365d5553 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:25:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:25:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:25:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:25:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:25:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:25:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:25:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:25:51 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dce42579-e49b-472a-bb91-e6c3365d5553 is timed out.
Nov 07 04:25:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Successfully detached device vdb from instance dce42579-e49b-472a-bb91-e6c3365d5553 from the live domain config.
Nov 07 04:25:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hsWQgOpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:25:51 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[948dde59-6704-4d11-a7ac-ab312d81d27a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:25:51 user nova-compute[74540]: No targets found.
Nov 07 04:25:51 user nova-compute[74540]: iSNS:
Nov 07 04:25:51 user nova-compute[74540]: No targets found.
Nov 07 04:25:51 user nova-compute[74540]: STATIC:
Nov 07 04:25:51 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304
Nov 07 04:25:51 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:25:51 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:25:51 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948
Nov 07 04:25:51 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:25:51 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:25:51 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:25:51 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:25:51 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:25:51 user nova-compute[74540]: FIRMWARE:
Nov 07 04:25:51 user nova-compute[74540]: No targets found.
Nov 07 04:25:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:25:51 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:25:51 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6e0093-6413-4418-9b76-f1dbdc14178a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a2fb19-ef60-464b-a94f-69c4a0ae4099]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:25:51 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:25:51 user nova-compute[74540]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)
Nov 07 04:25:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:25:51 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:25:51 user nova-compute[74540]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 (non-flash)
Nov 07 04:25:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc685870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304'): ({'sdd'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Removing single pathed devices sdd {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[41552fcf-21ca-4d10-bc5f-d61831956b9f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[431ea1b0-609e-4f95-ad1c-e88e153c40b9]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Flushing IO for device /dev/sdd {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d809ca4-b917-42a4-a964-ee71feb172bc]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca3e2c6-95a1-41ef-afd2-af7b5a7f9409]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42f8b3a-12b0-4730-b93b-48243997ee71]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a4cd6f-27e0-43df-9889-b98fad011091]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304, portal: 172.16.0.220,3260]
Nov 07 04:25:51 user nova-compute[74540]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304, portal: 172.16.0.220,3260] successful.
Nov 07 04:25:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e4fe9b-ff25-43b7-986a-6c695115f304 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f6c490-f98b-47e5-8f54-c72584f64be8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] <== disconnect_volume: return (323ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:25:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:25:52 user nova-compute[74540]: DEBUG nova.objects.instance [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lazy-loading 'flavor' on Instance uuid dce42579-e49b-472a-bb91-e6c3365d5553 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:25:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b5b914f3-b39f-4b4f-bdd1-a3b13c2be35f tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.853s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:25:52 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:25:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:25:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:25:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:25:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:25:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:25:52 user nova-compute[74540]: INFO nova.compute.manager [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Terminating instance
Nov 07 04:25:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-e632fdcb-19ed-4937-af7b-a62e0426ca03 req-279122f5-f0f0-47d3-a258-3849607518c4 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-unplugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e632fdcb-19ed-4937-af7b-a62e0426ca03 req-279122f5-f0f0-47d3-a258-3849607518c4 service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e632fdcb-19ed-4937-af7b-a62e0426ca03 req-279122f5-f0f0-47d3-a258-3849607518c4 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e632fdcb-19ed-4937-af7b-a62e0426ca03 req-279122f5-f0f0-47d3-a258-3849607518c4 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-e632fdcb-19ed-4937-af7b-a62e0426ca03 req-279122f5-f0f0-47d3-a258-3849607518c4 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-unplugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-e632fdcb-19ed-4937-af7b-a62e0426ca03 req-279122f5-f0f0-47d3-a258-3849607518c4 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-unplugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Instance destroyed successfully.
Nov 07 04:25:53 user nova-compute[74540]: DEBUG nova.objects.instance [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'resources' on Instance uuid cfdde86e-1e12-44f3-88d1-ca15a66e03e8 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-983957758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-983957758',id=39,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:22:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-2vfsbnzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:24:08Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=cfdde86e-1e12-44f3-88d1-ca15a66e03e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "5a551def-df79-49de-a5ce-f6dea568e6c8", "address": "fa:16:3e:dc:6c:b2", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a551def-df", "ovs_interfaceid": "5a551def-df79-49de-a5ce-f6dea568e6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6c:b2,bridge_name='br-int',has_traffic_filtering=True,id=5a551def-df79-49de-a5ce-f6dea568e6c8,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a551def-df') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_vif [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6c:b2,bridge_name='br-int',has_traffic_filtering=True,id=5a551def-df79-49de-a5ce-f6dea568e6c8,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a551def-df') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a551def-df, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ae14422-7f89-40e1-9a0f-878821926d4f) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: INFO os_vif [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:6c:b2,bridge_name='br-int',has_traffic_filtering=True,id=5a551def-df79-49de-a5ce-f6dea568e6c8,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a551def-df')
Nov 07 04:25:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIZCrXMg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:25:53 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a4baa7-575b-4ff4-81cb-32fa178ba93e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:25:53 user nova-compute[74540]: No targets found.
Nov 07 04:25:53 user nova-compute[74540]: iSNS:
Nov 07 04:25:53 user nova-compute[74540]: No targets found.
Nov 07 04:25:53 user nova-compute[74540]: STATIC:
Nov 07 04:25:53 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948
Nov 07 04:25:53 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:25:53 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:25:53 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:25:53 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:25:53 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:25:53 user nova-compute[74540]: FIRMWARE:
Nov 07 04:25:53 user nova-compute[74540]: No targets found.
Nov 07 04:25:53 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:25:53 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:25:53 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffdc9f7-ccf5-4122-ad21-720050ece37f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ec7645-7a43-4365-837d-7ef406e575cd]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:25:53 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:25:53 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:25:53 user nova-compute[74540]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 (non-flash)
Nov 07 04:25:53 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc238700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80a99b6-8066-4481-9b7d-c89631dc5129]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a238520-b6c3-46e1-8226-cf78acdbe757]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae5526b-8c4d-485b-a7d8-3309bfabc42f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7488938-d1f1-46cc-9b0e-e4981d0d907e]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3fb882-06f1-419f-8a19-4ce9d98b09b8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1bccad-2e45-4278-ba50-09795480f129]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948, portal: 172.16.0.220,3260]
Nov 07 04:25:54 user nova-compute[74540]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948, portal: 172.16.0.220,3260] successful.
Nov 07 04:25:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd64a5eb-fedd-44e2-9cc3-d9f8dda4c948 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeb3c4b-10c6-4387-8b53-c1ea36e1cf38]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] <== disconnect_volume: return (346ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:25:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Deleting instance files /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8_del
Nov 07 04:25:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Deletion of /opt/stack/data/nova/instances/cfdde86e-1e12-44f3-88d1-ca15a66e03e8_del complete
Nov 07 04:25:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:54 user nova-compute[74540]: INFO nova.compute.manager [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 07 04:25:54 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:25:54 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:25:55 user nova-compute[74540]: WARNING nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state active and task_state deleting.
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:25:55 user nova-compute[74540]: WARNING nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state active and task_state deleting.
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:25:55 user nova-compute[74540]: WARNING nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state active and task_state deleting.
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-unplugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-unplugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-unplugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Acquiring lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] No waiting events found dispatching network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:25:55 user nova-compute[74540]: WARNING nova.compute.manager [req-1955c0c3-f5c7-4416-94e0-de974e8729c2 req-971ca3ad-ef3f-4347-a769-f97b5383d3f3 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received unexpected event network-vif-plugged-5a551def-df79-49de-a5ce-f6dea568e6c8 for instance with vm_state active and task_state deleting.
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:25:55 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Took 1.17 seconds to deallocate network for instance.
Nov 07 04:25:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-8aba442e-d89d-4d7c-bf1e-e1b7f0f89469 req-55adf6a1-d35f-4ded-a3ce-cd3fb376f531 service nova] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Received event network-vif-deleted-5a551def-df79-49de-a5ce-f6dea568e6c8 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:25:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:25:56 user nova-compute[74540]: INFO nova.compute.manager [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: cfdde86e-1e12-44f3-88d1-ca15a66e03e8] Took 1.06 seconds to detach 1 volumes for instance.
Nov 07 04:25:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:25:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:25:56 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:25:56 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:25:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:25:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:25:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:25:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:25:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:25:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:25:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:25:56 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:25:56 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Deleted allocations for instance cfdde86e-1e12-44f3-88d1-ca15a66e03e8
Nov 07 04:25:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bea44f97-4a08-4553-a8aa-fc96f103e693 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "cfdde86e-1e12-44f3-88d1-ca15a66e03e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.950s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:25:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:25:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:57 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:25:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:25:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:25:58 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:25:58 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:25:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8478MB free_disk=24.599346160888672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance dce42579-e49b-472a-bb91-e6c3365d5553 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 7ea40dee-8c35-4508-a8c1-34772281aa15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:25:59 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Acquiring lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG nova.compute.manager [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:26:03 user nova-compute[74540]: INFO nova.compute.claims [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Claim successful on node user
Nov 07 04:26:03 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG nova.compute.manager [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG nova.compute.manager [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG nova.network.neutron [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:26:03 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:26:03 user nova-compute[74540]: DEBUG nova.compute.manager [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG nova.policy [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '089b27c6b06c428487098f5d1121fa14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f3744c755f444d69769b2e0f8edcd12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG nova.compute.manager [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:26:03 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Creating image(s)
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Acquiring lock "/opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "/opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "/opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.180s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk 1073741824" returned: 0 in 0.054s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG nova.network.neutron [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Successfully created port: f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Cannot resize image /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Ensure instance console log exists: /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.network.neutron [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Successfully updated port: f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Acquiring lock "refresh_cache-fab2c59a-7b98-4704-a4bf-d9fa8d714b16" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Acquired lock "refresh_cache-fab2c59a-7b98-4704-a4bf-d9fa8d714b16" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.network.neutron [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-57d93622-4ef1-4fe8-86b8-c134acda1acb req-54b4e79f-0d32-4777-8042-bb95b62a8e0b service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Received event network-changed-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.compute.manager [req-57d93622-4ef1-4fe8-86b8-c134acda1acb req-54b4e79f-0d32-4777-8042-bb95b62a8e0b service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Refreshing instance network info cache due to event network-changed-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-57d93622-4ef1-4fe8-86b8-c134acda1acb req-54b4e79f-0d32-4777-8042-bb95b62a8e0b service nova] Acquiring lock "refresh_cache-fab2c59a-7b98-4704-a4bf-d9fa8d714b16" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.network.neutron [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.network.neutron [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Updating instance_info_cache with network_info: [{"id": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "address": "fa:16:3e:df:bc:42", "network": {"id": "10169c69-19d4-46fc-9ef7-cde9c7d58a42", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85e4cd2fa8e74df0a62d09de21e82a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02ce80b-b7", "ovs_interfaceid": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Releasing lock "refresh_cache-fab2c59a-7b98-4704-a4bf-d9fa8d714b16" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.compute.manager [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Instance network_info: |[{"id": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "address": "fa:16:3e:df:bc:42", "network": {"id": "10169c69-19d4-46fc-9ef7-cde9c7d58a42", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85e4cd2fa8e74df0a62d09de21e82a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02ce80b-b7", "ovs_interfaceid": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-57d93622-4ef1-4fe8-86b8-c134acda1acb req-54b4e79f-0d32-4777-8042-bb95b62a8e0b service nova] Acquired lock "refresh_cache-fab2c59a-7b98-4704-a4bf-d9fa8d714b16" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.network.neutron [req-57d93622-4ef1-4fe8-86b8-c134acda1acb req-54b4e79f-0d32-4777-8042-bb95b62a8e0b service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Refreshing network info cache for port f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Start _get_guest_xml network_info=[{"id": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "address": "fa:16:3e:df:bc:42", "network": {"id": "10169c69-19d4-46fc-9ef7-cde9c7d58a42", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85e4cd2fa8e74df0a62d09de21e82a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02ce80b-b7", "ovs_interfaceid": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:26:05 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:26:05 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1980235109',display_name='tempest-VolumesNegativeTest-instance-1980235109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1980235109',id=42,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f3744c755f444d69769b2e0f8edcd12',ramdisk_id='',reservation_id='r-2bjg5uks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-150463387',owner_user_name='tempest-VolumesNegativeTest-150463387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:26:04Z,user_data=None,user_id='089b27c6b06c428487098f5d1121fa14',uuid=fab2c59a-7b98-4704-a4bf-d9fa8d714b16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "address": "fa:16:3e:df:bc:42", "network": {"id": "10169c69-19d4-46fc-9ef7-cde9c7d58a42", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85e4cd2fa8e74df0a62d09de21e82a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02ce80b-b7", "ovs_interfaceid": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Converting VIF {"id": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "address": "fa:16:3e:df:bc:42", "network": {"id": "10169c69-19d4-46fc-9ef7-cde9c7d58a42", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85e4cd2fa8e74df0a62d09de21e82a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02ce80b-b7", "ovs_interfaceid": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=f02ce80b-b71d-4f79-ad8a-929aa0ca1e04,network=Network(10169c69-19d4-46fc-9ef7-cde9c7d58a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02ce80b-b7') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.objects.instance [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lazy-loading 'pci_devices' on Instance uuid fab2c59a-7b98-4704-a4bf-d9fa8d714b16 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:26:05 user nova-compute[74540]:   <uuid>fab2c59a-7b98-4704-a4bf-d9fa8d714b16</uuid>
Nov 07 04:26:05 user nova-compute[74540]:   <name>instance-0000002a</name>
Nov 07 04:26:05 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:26:05 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:26:05 user nova-compute[74540]:   <metadata>
Nov 07 04:26:05 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:26:05 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:26:05 user nova-compute[74540]:       <nova:name>tempest-VolumesNegativeTest-instance-1980235109</nova:name>
Nov 07 04:26:05 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:26:05</nova:creationTime>
Nov 07 04:26:05 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:26:05 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:26:05 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:26:05 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:26:05 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:26:05 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:26:05 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:26:05 user nova-compute[74540]:       <nova:owner>
Nov 07 04:26:05 user nova-compute[74540]:         <nova:user uuid="089b27c6b06c428487098f5d1121fa14">tempest-VolumesNegativeTest-150463387-project-member</nova:user>
Nov 07 04:26:05 user nova-compute[74540]:         <nova:project uuid="1f3744c755f444d69769b2e0f8edcd12">tempest-VolumesNegativeTest-150463387</nova:project>
Nov 07 04:26:05 user nova-compute[74540]:       </nova:owner>
Nov 07 04:26:05 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:26:05 user nova-compute[74540]:       <nova:ports>
Nov 07 04:26:05 user nova-compute[74540]:         <nova:port uuid="f02ce80b-b71d-4f79-ad8a-929aa0ca1e04">
Nov 07 04:26:05 user nova-compute[74540]:           <nova:ip type="fixed" address="192.168.233.233" ipVersion="4"/>
Nov 07 04:26:05 user nova-compute[74540]:         </nova:port>
Nov 07 04:26:05 user nova-compute[74540]:       </nova:ports>
Nov 07 04:26:05 user nova-compute[74540]:     </nova:instance>
Nov 07 04:26:05 user nova-compute[74540]:   </metadata>
Nov 07 04:26:05 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:26:05 user nova-compute[74540]:     <system>
Nov 07 04:26:05 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:26:05 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:26:05 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:26:05 user nova-compute[74540]:       <entry name="serial">fab2c59a-7b98-4704-a4bf-d9fa8d714b16</entry>
Nov 07 04:26:05 user nova-compute[74540]:       <entry name="uuid">fab2c59a-7b98-4704-a4bf-d9fa8d714b16</entry>
Nov 07 04:26:05 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:26:05 user nova-compute[74540]:     </system>
Nov 07 04:26:05 user nova-compute[74540]:   </sysinfo>
Nov 07 04:26:05 user nova-compute[74540]:   <os>
Nov 07 04:26:05 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:26:05 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:26:05 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:26:05 user nova-compute[74540]:   </os>
Nov 07 04:26:05 user nova-compute[74540]:   <features>
Nov 07 04:26:05 user nova-compute[74540]:     <acpi/>
Nov 07 04:26:05 user nova-compute[74540]:     <apic/>
Nov 07 04:26:05 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:26:05 user nova-compute[74540]:   </features>
Nov 07 04:26:05 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:26:05 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:26:05 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:26:05 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:26:05 user nova-compute[74540]:   </clock>
Nov 07 04:26:05 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:26:05 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:26:05 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:26:05 user nova-compute[74540]:   </cpu>
Nov 07 04:26:05 user nova-compute[74540]:   <devices>
Nov 07 04:26:05 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:26:05 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:26:05 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk"/>
Nov 07 04:26:05 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:26:05 user nova-compute[74540]:     </disk>
Nov 07 04:26:05 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:26:05 user nova-compute[74540]:       <mac address="fa:16:3e:df:bc:42"/>
Nov 07 04:26:05 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:26:05 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:26:05 user nova-compute[74540]:       <target dev="tapf02ce80b-b7"/>
Nov 07 04:26:05 user nova-compute[74540]:     </interface>
Nov 07 04:26:05 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:26:05 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/console.log" append="off"/>
Nov 07 04:26:05 user nova-compute[74540]:     </serial>
Nov 07 04:26:05 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:26:05 user nova-compute[74540]:     <video>
Nov 07 04:26:05 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:26:05 user nova-compute[74540]:     </video>
Nov 07 04:26:05 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:26:05 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:26:05 user nova-compute[74540]:     </rng>
Nov 07 04:26:05 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:26:05 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:26:05 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:26:05 user nova-compute[74540]:     </memballoon>
Nov 07 04:26:05 user nova-compute[74540]:   </devices>
Nov 07 04:26:05 user nova-compute[74540]: </domain>
Nov 07 04:26:05 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1980235109',display_name='tempest-VolumesNegativeTest-instance-1980235109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1980235109',id=42,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f3744c755f444d69769b2e0f8edcd12',ramdisk_id='',reservation_id='r-2bjg5uks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-150463387',owner_user_name='tempest-VolumesNegativeTest-150463387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:26:04Z,user_data=None,user_id='089b27c6b06c428487098f5d1121fa14',uuid=fab2c59a-7b98-4704-a4bf-d9fa8d714b16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "address": "fa:16:3e:df:bc:42", "network": {"id": "10169c69-19d4-46fc-9ef7-cde9c7d58a42", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85e4cd2fa8e74df0a62d09de21e82a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02ce80b-b7", "ovs_interfaceid": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Converting VIF {"id": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "address": "fa:16:3e:df:bc:42", "network": {"id": "10169c69-19d4-46fc-9ef7-cde9c7d58a42", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85e4cd2fa8e74df0a62d09de21e82a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02ce80b-b7", "ovs_interfaceid": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=f02ce80b-b71d-4f79-ad8a-929aa0ca1e04,network=Network(10169c69-19d4-46fc-9ef7-cde9c7d58a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02ce80b-b7') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG os_vif [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=f02ce80b-b71d-4f79-ad8a-929aa0ca1e04,network=Network(10169c69-19d4-46fc-9ef7-cde9c7d58a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02ce80b-b7') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e401534-4d40-5ad2-9ceb-ed2cbbcbc8a6', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf02ce80b-b7, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf02ce80b-b7, col_values=(('qos', UUID('78b0aaa4-7103-4609-ba88-1cd7afd1c15e')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf02ce80b-b7, col_values=(('external_ids', {'iface-id': 'f02ce80b-b71d-4f79-ad8a-929aa0ca1e04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:bc:42', 'vm-uuid': 'fab2c59a-7b98-4704-a4bf-d9fa8d714b16'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:05 user nova-compute[74540]: INFO os_vif [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=f02ce80b-b71d-4f79-ad8a-929aa0ca1e04,network=Network(10169c69-19d4-46fc-9ef7-cde9c7d58a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02ce80b-b7')
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] No VIF found with MAC fa:16:3e:df:bc:42, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.network.neutron [req-57d93622-4ef1-4fe8-86b8-c134acda1acb req-54b4e79f-0d32-4777-8042-bb95b62a8e0b service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Updated VIF entry in instance network info cache for port f02ce80b-b71d-4f79-ad8a-929aa0ca1e04. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:26:05 user nova-compute[74540]: DEBUG nova.network.neutron [req-57d93622-4ef1-4fe8-86b8-c134acda1acb req-54b4e79f-0d32-4777-8042-bb95b62a8e0b service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Updating instance_info_cache with network_info: [{"id": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "address": "fa:16:3e:df:bc:42", "network": {"id": "10169c69-19d4-46fc-9ef7-cde9c7d58a42", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85e4cd2fa8e74df0a62d09de21e82a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02ce80b-b7", "ovs_interfaceid": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:26:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-57d93622-4ef1-4fe8-86b8-c134acda1acb req-54b4e79f-0d32-4777-8042-bb95b62a8e0b service nova] Releasing lock "refresh_cache-fab2c59a-7b98-4704-a4bf-d9fa8d714b16" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:26:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-0f6b28db-9f3c-43cf-a177-861ac6d838d9 req-7df1c17c-fa2d-445d-931e-402169221acb service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Received event network-vif-plugged-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:26:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0f6b28db-9f3c-43cf-a177-861ac6d838d9 req-7df1c17c-fa2d-445d-931e-402169221acb service nova] Acquiring lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0f6b28db-9f3c-43cf-a177-861ac6d838d9 req-7df1c17c-fa2d-445d-931e-402169221acb service nova] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0f6b28db-9f3c-43cf-a177-861ac6d838d9 req-7df1c17c-fa2d-445d-931e-402169221acb service nova] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-0f6b28db-9f3c-43cf-a177-861ac6d838d9 req-7df1c17c-fa2d-445d-931e-402169221acb service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] No waiting events found dispatching network-vif-plugged-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:26:07 user nova-compute[74540]: WARNING nova.compute.manager [req-0f6b28db-9f3c-43cf-a177-861ac6d838d9 req-7df1c17c-fa2d-445d-931e-402169221acb service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Received unexpected event network-vif-plugged-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 for instance with vm_state building and task_state spawning.
Nov 07 04:26:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:08 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:26:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:26:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-dce42579-e49b-472a-bb91-e6c3365d5553" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:26:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-dce42579-e49b-472a-bb91-e6c3365d5553" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:26:08 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:26:08 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Updating instance_info_cache with network_info: [{"id": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "address": "fa:16:3e:e5:a0:97", "network": {"id": "e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-278886072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151659fcbec241f7ae4ecd1516724fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adb4f7-18", "ovs_interfaceid": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:26:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-dce42579-e49b-472a-bb91-e6c3365d5553" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:26:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG nova.compute.manager [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:26:09 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Instance spawned successfully.
Nov 07 04:26:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:26:09 user nova-compute[74540]: INFO nova.compute.manager [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 07 04:26:09 user nova-compute[74540]: DEBUG nova.compute.manager [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-dff608ca-750a-491e-8d2f-ad4a957fff1b req-ccc25419-65aa-43a9-a1e8-6dd6b249efc3 service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Received event network-vif-plugged-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dff608ca-750a-491e-8d2f-ad4a957fff1b req-ccc25419-65aa-43a9-a1e8-6dd6b249efc3 service nova] Acquiring lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dff608ca-750a-491e-8d2f-ad4a957fff1b req-ccc25419-65aa-43a9-a1e8-6dd6b249efc3 service nova] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dff608ca-750a-491e-8d2f-ad4a957fff1b req-ccc25419-65aa-43a9-a1e8-6dd6b249efc3 service nova] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-dff608ca-750a-491e-8d2f-ad4a957fff1b req-ccc25419-65aa-43a9-a1e8-6dd6b249efc3 service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] No waiting events found dispatching network-vif-plugged-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:26:09 user nova-compute[74540]: WARNING nova.compute.manager [req-dff608ca-750a-491e-8d2f-ad4a957fff1b req-ccc25419-65aa-43a9-a1e8-6dd6b249efc3 service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Received unexpected event network-vif-plugged-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 for instance with vm_state building and task_state spawning.
Nov 07 04:26:09 user nova-compute[74540]: INFO nova.compute.manager [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Took 6.35 seconds to build instance.
Nov 07 04:26:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-254ddf76-3ef9-48a1-87ac-19abf520f040 tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.453s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:21 user nova-compute[74540]: INFO nova.compute.manager [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Terminating instance
Nov 07 04:26:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Instance destroyed successfully.
Nov 07 04:26:21 user nova-compute[74540]: DEBUG nova.objects.instance [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lazy-loading 'resources' on Instance uuid dce42579-e49b-472a-bb91-e6c3365d5553 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1057099899',display_name='tempest-TestServerVolumeAttachmentScenario-server-1057099899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1057099899',id=40,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBVqickahYBVFhD25NXpPeJnv7W7SpRXHzMejAOG4lGZ2Rk9gMUs0zmGNhsh+VyWR50GNyOrhVxFG9VOJKFPukiR0bAQaYE2aAldBKgFGUHK5Sw5B9zlTuXWQISkpt7kA==',key_name='tempest-keypair-1258064914',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:21:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='151659fcbec241f7ae4ecd1516724fda',ramdisk_id='',reservation_id='r-xzxfnhzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1983912952',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1983912952-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:21:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c9c8a93cc874aaeaf8f6bda9bad3974',uuid=dce42579-e49b-472a-bb91-e6c3365d5553,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "address": "fa:16:3e:e5:a0:97", "network": {"id": "e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-278886072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151659fcbec241f7ae4ecd1516724fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adb4f7-18", "ovs_interfaceid": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Converting VIF {"id": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "address": "fa:16:3e:e5:a0:97", "network": {"id": "e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-278886072-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151659fcbec241f7ae4ecd1516724fda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76adb4f7-18", "ovs_interfaceid": "76adb4f7-18f1-44d2-8109-fb2f8b05927d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a0:97,bridge_name='br-int',has_traffic_filtering=True,id=76adb4f7-18f1-44d2-8109-fb2f8b05927d,network=Network(e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adb4f7-18') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG os_vif [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a0:97,bridge_name='br-int',has_traffic_filtering=True,id=76adb4f7-18f1-44d2-8109-fb2f8b05927d,network=Network(e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adb4f7-18') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76adb4f7-18, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf679a6b-b2a1-4b9b-b300-165e4eb4be21) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:21 user nova-compute[74540]: INFO os_vif [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a0:97,bridge_name='br-int',has_traffic_filtering=True,id=76adb4f7-18f1-44d2-8109-fb2f8b05927d,network=Network(e73e19ff-d4e9-4dc7-9d15-3a94afc4bb58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76adb4f7-18')
Nov 07 04:26:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Deleting instance files /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553_del
Nov 07 04:26:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Deletion of /opt/stack/data/nova/instances/dce42579-e49b-472a-bb91-e6c3365d5553_del complete
Nov 07 04:26:22 user nova-compute[74540]: INFO nova.compute.manager [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 07 04:26:22 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-3814af87-3abe-4b44-9352-c43ff4e8ac24 req-8db3daac-ebad-4b98-8544-29c43b793b8d service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Received event network-vif-unplugged-76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3814af87-3abe-4b44-9352-c43ff4e8ac24 req-8db3daac-ebad-4b98-8544-29c43b793b8d service nova] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3814af87-3abe-4b44-9352-c43ff4e8ac24 req-8db3daac-ebad-4b98-8544-29c43b793b8d service nova] Lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3814af87-3abe-4b44-9352-c43ff4e8ac24 req-8db3daac-ebad-4b98-8544-29c43b793b8d service nova] Lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-3814af87-3abe-4b44-9352-c43ff4e8ac24 req-8db3daac-ebad-4b98-8544-29c43b793b8d service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] No waiting events found dispatching network-vif-unplugged-76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-3814af87-3abe-4b44-9352-c43ff4e8ac24 req-8db3daac-ebad-4b98-8544-29c43b793b8d service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Received event network-vif-unplugged-76adb4f7-18f1-44d2-8109-fb2f8b05927d for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:23 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:26:23 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Took 1.35 seconds to deallocate network for instance.
Nov 07 04:26:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-0ced3bbb-8a73-441e-8cf9-f08c4f1da150 req-291d7c74-8bba-4ec5-bbc5-d44eb36a2e62 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Received event network-vif-deleted-76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:26:23 user nova-compute[74540]: INFO nova.compute.manager [req-0ced3bbb-8a73-441e-8cf9-f08c4f1da150 req-291d7c74-8bba-4ec5-bbc5-d44eb36a2e62 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Neutron deleted interface 76adb4f7-18f1-44d2-8109-fb2f8b05927d; detaching it from the instance and deleting it from the info cache
Nov 07 04:26:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-0ced3bbb-8a73-441e-8cf9-f08c4f1da150 req-291d7c74-8bba-4ec5-bbc5-d44eb36a2e62 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:26:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-0ced3bbb-8a73-441e-8cf9-f08c4f1da150 req-291d7c74-8bba-4ec5-bbc5-d44eb36a2e62 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Detach interface failed, port_id=76adb4f7-18f1-44d2-8109-fb2f8b05927d, reason: Instance dce42579-e49b-472a-bb91-e6c3365d5553 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:26:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:23 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:26:23 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:26:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:23 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Deleted allocations for instance dce42579-e49b-472a-bb91-e6c3365d5553
Nov 07 04:26:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0f17a1a1-b738-4a3e-9bce-cc92759d58a2 tempest-TestServerVolumeAttachmentScenario-1983912952 tempest-TestServerVolumeAttachmentScenario-1983912952-project-member] Lock "dce42579-e49b-472a-bb91-e6c3365d5553" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.809s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-0a7ea4ec-bf3b-4e05-83cb-813eaab73448 req-5bd65e17-c306-4d4e-a2d1-ea6764901157 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Received event network-vif-plugged-76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:26:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0a7ea4ec-bf3b-4e05-83cb-813eaab73448 req-5bd65e17-c306-4d4e-a2d1-ea6764901157 service nova] Acquiring lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0a7ea4ec-bf3b-4e05-83cb-813eaab73448 req-5bd65e17-c306-4d4e-a2d1-ea6764901157 service nova] Lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0a7ea4ec-bf3b-4e05-83cb-813eaab73448 req-5bd65e17-c306-4d4e-a2d1-ea6764901157 service nova] Lock "dce42579-e49b-472a-bb91-e6c3365d5553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:24 user nova-compute[74540]: DEBUG nova.compute.manager [req-0a7ea4ec-bf3b-4e05-83cb-813eaab73448 req-5bd65e17-c306-4d4e-a2d1-ea6764901157 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] No waiting events found dispatching network-vif-plugged-76adb4f7-18f1-44d2-8109-fb2f8b05927d {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:26:24 user nova-compute[74540]: WARNING nova.compute.manager [req-0a7ea4ec-bf3b-4e05-83cb-813eaab73448 req-5bd65e17-c306-4d4e-a2d1-ea6764901157 service nova] [instance: dce42579-e49b-472a-bb91-e6c3365d5553] Received unexpected event network-vif-plugged-76adb4f7-18f1-44d2-8109-fb2f8b05927d for instance with vm_state deleted and task_state None.
Nov 07 04:26:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'flavor' on Instance uuid 7ea40dee-8c35-4508-a8c1-34772281aa15 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:32 user nova-compute[74540]: INFO nova.compute.manager [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Attaching volume b3cb1bfa-ea57-4213-b444-65ee81deebf7 to /dev/vdb
Nov 07 04:26:32 user nova-compute[74540]: DEBUG os_brick.utils [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf56ccfc-9c5b-4e50-a44a-63779eedd126]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2506fbf8-4b00-448c-897a-4422072445dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad35919-6d87-4cba-8c05-4e60501d69ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[97caad52-0318-413c-8660-896606c02f5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:26:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:26:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:26:33 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:26:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f31be6-b024-4ccd-98d5-76e53eb2cec7]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:26:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:26:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:26:33 user nova-compute[74540]: DEBUG os_brick.utils [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:26:33 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updating existing volume attachment record: 99c7f8a2-efee-44e5-817a-0afb308fa042 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:26:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "26890199-c159-45e4-9d69-08497f81d5c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:26:43 user nova-compute[74540]: INFO nova.compute.claims [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Claim successful on node user
Nov 07 04:26:43 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG nova.network.neutron [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:43 user nova-compute[74540]: INFO nova.compute.manager [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Terminating instance
Nov 07 04:26:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:26:43 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:26:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:26:43 user nova-compute[74540]: INFO nova.virt.block_device [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Booting with volume 7719ba97-3b4a-43e1-96b0-ce5fca24be6a at /dev/vda
Nov 07 04:26:43 user nova-compute[74540]: DEBUG nova.policy [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15f998264d6c4ddf89f55894400758cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973e71d3c5dd4e268defadc32013ea39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG os_brick.utils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc28064-0292-4f2a-80ba-9e6b97e039f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7ccbf6-2dbc-4e7f-8b58-02d8dc14a569]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[277855db-0dc6-48f9-be17-b428ec2452cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c125d624-3417-495b-9e25-5e07e2c866ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-02459085-114f-42e7-b797-388457e9019c req-818b8385-3151-48c3-812a-4280ce980672 service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Received event network-vif-unplugged-74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-02459085-114f-42e7-b797-388457e9019c req-818b8385-3151-48c3-812a-4280ce980672 service nova] Acquiring lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-02459085-114f-42e7-b797-388457e9019c req-818b8385-3151-48c3-812a-4280ce980672 service nova] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-02459085-114f-42e7-b797-388457e9019c req-818b8385-3151-48c3-812a-4280ce980672 service nova] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-02459085-114f-42e7-b797-388457e9019c req-818b8385-3151-48c3-812a-4280ce980672 service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] No waiting events found dispatching network-vif-unplugged-74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-02459085-114f-42e7-b797-388457e9019c req-818b8385-3151-48c3-812a-4280ce980672 service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Received event network-vif-unplugged-74b9d20a-b195-4f89-8cae-b198549a6e7b for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:26:44 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb482aa5-aba3-4691-957a-0c94b3d22c06]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG os_brick.utils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updating existing volume attachment record: 0ac6df76-e145-4a00-bded-c92249452db5 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:44 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Instance destroyed successfully.
Nov 07 04:26:44 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'resources' on Instance uuid 47f331c2-4e12-45cc-8b9d-a566a0dbbca1 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:16:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1735648456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1735648456',id=37,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:16:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-f0ieucg5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:18:27Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=47f331c2-4e12-45cc-8b9d-a566a0dbbca1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "address": "fa:16:3e:95:b2:60", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b9d20a-b1", "ovs_interfaceid": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "address": "fa:16:3e:95:b2:60", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b9d20a-b1", "ovs_interfaceid": "74b9d20a-b195-4f89-8cae-b198549a6e7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:b2:60,bridge_name='br-int',has_traffic_filtering=True,id=74b9d20a-b195-4f89-8cae-b198549a6e7b,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b9d20a-b1') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG os_vif [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:b2:60,bridge_name='br-int',has_traffic_filtering=True,id=74b9d20a-b195-4f89-8cae-b198549a6e7b,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b9d20a-b1') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74b9d20a-b1, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=598df69f-3cfb-4af7-a170-244851d7f262) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:44 user nova-compute[74540]: INFO os_vif [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:b2:60,bridge_name='br-int',has_traffic_filtering=True,id=74b9d20a-b195-4f89-8cae-b198549a6e7b,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74b9d20a-b1')
Nov 07 04:26:44 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Deleting instance files /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1_del
Nov 07 04:26:44 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Deletion of /opt/stack/data/nova/instances/47f331c2-4e12-45cc-8b9d-a566a0dbbca1_del complete
Nov 07 04:26:44 user nova-compute[74540]: INFO nova.compute.manager [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 07 04:26:44 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:26:44 user nova-compute[74540]: DEBUG nova.network.neutron [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Successfully created port: 7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:26:45 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Took 0.51 seconds to deallocate network for instance.
Nov 07 04:26:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG nova.network.neutron [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Successfully updated port: 7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquired lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG nova.network.neutron [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG nova.compute.manager [req-5303e88d-7bd3-4ee9-bb22-60dfcdf00b09 req-d19dacb0-6557-4144-abec-9a531ff813b3 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-changed-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG nova.compute.manager [req-5303e88d-7bd3-4ee9-bb22-60dfcdf00b09 req-d19dacb0-6557-4144-abec-9a531ff813b3 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Refreshing instance network info cache due to event network-changed-7e6e59a5-614a-4fe8-ab91-bdf847c4209e. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5303e88d-7bd3-4ee9-bb22-60dfcdf00b09 req-d19dacb0-6557-4144-abec-9a531ff813b3 service nova] Acquiring lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG nova.network.neutron [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:45 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Deleted allocations for instance 47f331c2-4e12-45cc-8b9d-a566a0dbbca1
Nov 07 04:26:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4bdca6db-694d-4b7b-b7ab-1d1838afd22d tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.910s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG nova.network.neutron [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updating instance_info_cache with network_info: [{"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Releasing lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG nova.compute.manager [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Instance network_info: |[{"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5303e88d-7bd3-4ee9-bb22-60dfcdf00b09 req-d19dacb0-6557-4144-abec-9a531ff813b3 service nova] Acquired lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:26:45 user nova-compute[74540]: DEBUG nova.network.neutron [req-5303e88d-7bd3-4ee9-bb22-60dfcdf00b09 req-d19dacb0-6557-4144-abec-9a531ff813b3 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Refreshing network info cache for port 7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:26:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-dc2c2270-6424-4b90-bc6a-9965d6f8da27 req-3065167e-a540-4fa6-8643-45a0769b8241 service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Received event network-vif-plugged-74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:26:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dc2c2270-6424-4b90-bc6a-9965d6f8da27 req-3065167e-a540-4fa6-8643-45a0769b8241 service nova] Acquiring lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dc2c2270-6424-4b90-bc6a-9965d6f8da27 req-3065167e-a540-4fa6-8643-45a0769b8241 service nova] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-dc2c2270-6424-4b90-bc6a-9965d6f8da27 req-3065167e-a540-4fa6-8643-45a0769b8241 service nova] Lock "47f331c2-4e12-45cc-8b9d-a566a0dbbca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-dc2c2270-6424-4b90-bc6a-9965d6f8da27 req-3065167e-a540-4fa6-8643-45a0769b8241 service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] No waiting events found dispatching network-vif-plugged-74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:26:46 user nova-compute[74540]: WARNING nova.compute.manager [req-dc2c2270-6424-4b90-bc6a-9965d6f8da27 req-3065167e-a540-4fa6-8643-45a0769b8241 service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Received unexpected event network-vif-plugged-74b9d20a-b195-4f89-8cae-b198549a6e7b for instance with vm_state deleted and task_state None.
Nov 07 04:26:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-dc2c2270-6424-4b90-bc6a-9965d6f8da27 req-3065167e-a540-4fa6-8643-45a0769b8241 service nova] [instance: 47f331c2-4e12-45cc-8b9d-a566a0dbbca1] Received event network-vif-deleted-74b9d20a-b195-4f89-8cae-b198549a6e7b {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:26:46 user nova-compute[74540]: DEBUG nova.network.neutron [req-5303e88d-7bd3-4ee9-bb22-60dfcdf00b09 req-d19dacb0-6557-4144-abec-9a531ff813b3 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updated VIF entry in instance network info cache for port 7e6e59a5-614a-4fe8-ab91-bdf847c4209e. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:26:46 user nova-compute[74540]: DEBUG nova.network.neutron [req-5303e88d-7bd3-4ee9-bb22-60dfcdf00b09 req-d19dacb0-6557-4144-abec-9a531ff813b3 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updating instance_info_cache with network_info: [{"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:26:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5303e88d-7bd3-4ee9-bb22-60dfcdf00b09 req-d19dacb0-6557-4144-abec-9a531ff813b3 service nova] Releasing lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:26:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:26:48 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:26:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:52 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:26:52 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUDCLiag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:26:54 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:26:54 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:26:54 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cb33e2-18c9-46ab-9358-90fba761f2fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:26:54 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b227f1d7-1497-48e5-bdc3-8ac75d03a4d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7] added
Nov 07 04:26:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6ee67f-a37f-473c-82bb-5d93079bdc88]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c227b9-e78b-4314-8490-82d07de6fbd7]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUDCLiag {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUDCLiag" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f0ffe3-0219-4ec9-bd86-172668e8183b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JUDCLiag'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a984027d-2a34-4402-8c7b-cd0405ca09c7]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f0d7d9-1f82-4681-a5ae-d07be6a9c0c7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:26:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:26:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:26:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c4fd9d-c50d-43b6-8f5c-fcdbbd8da19e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260]
Nov 07 04:26:55 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260] successful.
Nov 07 04:26:55 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c5134e-e4a3-4976-b738-5b429726fff0]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f74918d-a371-4328-a910-8dbc1fdf0655]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:26:55 user nova-compute[74540]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:26:55 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:26:55 user nova-compute[74540]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:26:55 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22fb1d6-10cd-4856-8d29-6e84fa656a57]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:26:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUDCLiag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26166616463653639', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166616463653639', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'flavor' on Instance uuid 7ea40dee-8c35-4508-a8c1-34772281aa15 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:26:56 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:26:56 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:26:56 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:26:56 user nova-compute[74540]:   <serial>b3cb1bfa-ea57-4213-b444-65ee81deebf7</serial>
Nov 07 04:26:56 user nova-compute[74540]: </disk>
Nov 07 04:26:56 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] No VIF found with MAC fa:16:3e:52:b2:6e, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:26:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f4bfa2f9-0a60-441b-9f06-a28258fbf726 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.964s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:57 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:26:58 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:26:58 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:26:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:26:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:26:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:26:58 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:26:58 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:26:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:00 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:27:00 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:27:00 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8579MB free_disk=24.712696075439453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance ac4742cd-822a-43b1-adc7-4c7452bd0e35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 7ea40dee-8c35-4508-a8c1-34772281aa15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance fab2c59a-7b98-4704-a4bf-d9fa8d714b16 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 26890199-c159-45e4-9d69-08497f81d5c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:27:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.compute.manager [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:27:05 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Creating image(s)
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Ensure instance console log exists: /opt/stack/data/nova/instances/26890199-c159-45e4-9d69-08497f81d5c2/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Start _get_guest_xml network_info=[{"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdxcXUkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26890199-c159-45e4-9d69-08497f81d5c2', 'attached_at': '', 'detached_at': '', 'volume_id': '7719ba97-3b4a-43e1-96b0-ce5fca24be6a', 'serial': '7719ba97-3b4a-43e1-96b0-ce5fca24be6a'}, 'boot_index': 0, 'attachment_id': '0ac6df76-e145-4a00-bded-c92249452db5', 'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:27:05 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:27:05 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:27:05 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdxcXUkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:27:06 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:27:06 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:27:06 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1824f4-7c99-46b5-8c41-71cd9aa87fe2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:27:06 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd495001-caaa-45d7-a7fd-ba44a638f738]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a] added
Nov 07 04:27:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ee7fb0-dc53-4d11-a733-b77e9f839787]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83dbbee-5b70-4370-a11b-0870a6f7ee8f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdxcXUkS {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdxcXUkS" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d3caa5-40ab-4770-930a-b3d69bd69200]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CdxcXUkS'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[99af5c64-27d0-47cf-b81f-7907c6fe7bf6]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[637a7078-c2e1-41d5-aac5-03ba2eb29a44]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:27:06 user nova-compute[74540]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:27:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:27:06 user nova-compute[74540]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:27:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[24373151-0c78-475e-a931-00a63faeaa99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260]
Nov 07 04:27:06 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260] successful.
Nov 07 04:27:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b55e66-8110-4423-aa80-79a5fa4bb1a4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[252cff9a-31f5-4c6d-a3c1-d76c91908ad6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:27:06 user nova-compute[74540]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:27:06 user nova-compute[74540]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:27:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:27:06 user nova-compute[74540]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:27:06 user nova-compute[74540]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:27:06 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6043416e-ec19-49c5-82ba-13f2e755c543]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:06 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdxcXUkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23237383734303766', 'path': '/dev/sdd'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237383734303766', 'path': '/dev/sdd'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-707186112',display_name='tempest-TestShelveInstance-server-707186112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-707186112',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANy3Hf05eA8Uao7ke4zYpDwI2ZJAlLySHnaLwNxrbFZ1mnbZhcv+IFwZq9Hcnhjlrfh/wz5C28+C6yR1LiJlaQPXFaVWzpl1YT74QjHyZN5OUDEqDzeySQfMbDvymXpnw==',key_name='tempest-TestShelveInstance-1395746955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='973e71d3c5dd4e268defadc32013ea39',ramdisk_id='',reservation_id='r-ulrbyx8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1609380101',owner_user_name='tempest-TestShelveInstance-1609380101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:26:44Z,user_data=None,user_id='15f998264d6c4ddf89f55894400758cb',uuid=26890199-c159-45e4-9d69-08497f81d5c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Converting VIF {"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.objects.instance [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lazy-loading 'pci_devices' on Instance uuid 26890199-c159-45e4-9d69-08497f81d5c2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:27:07 user nova-compute[74540]:   <uuid>26890199-c159-45e4-9d69-08497f81d5c2</uuid>
Nov 07 04:27:07 user nova-compute[74540]:   <name>instance-0000002b</name>
Nov 07 04:27:07 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:27:07 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:27:07 user nova-compute[74540]:   <metadata>
Nov 07 04:27:07 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:27:07 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:27:07 user nova-compute[74540]:       <nova:name>tempest-TestShelveInstance-server-707186112</nova:name>
Nov 07 04:27:07 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:27:05</nova:creationTime>
Nov 07 04:27:07 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:27:07 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:27:07 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:27:07 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:27:07 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:27:07 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:27:07 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:27:07 user nova-compute[74540]:       <nova:owner>
Nov 07 04:27:07 user nova-compute[74540]:         <nova:user uuid="15f998264d6c4ddf89f55894400758cb">tempest-TestShelveInstance-1609380101-project-member</nova:user>
Nov 07 04:27:07 user nova-compute[74540]:         <nova:project uuid="973e71d3c5dd4e268defadc32013ea39">tempest-TestShelveInstance-1609380101</nova:project>
Nov 07 04:27:07 user nova-compute[74540]:       </nova:owner>
Nov 07 04:27:07 user nova-compute[74540]:       <nova:ports>
Nov 07 04:27:07 user nova-compute[74540]:         <nova:port uuid="7e6e59a5-614a-4fe8-ab91-bdf847c4209e">
Nov 07 04:27:07 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 04:27:07 user nova-compute[74540]:         </nova:port>
Nov 07 04:27:07 user nova-compute[74540]:       </nova:ports>
Nov 07 04:27:07 user nova-compute[74540]:     </nova:instance>
Nov 07 04:27:07 user nova-compute[74540]:   </metadata>
Nov 07 04:27:07 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:27:07 user nova-compute[74540]:     <system>
Nov 07 04:27:07 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:27:07 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:27:07 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:27:07 user nova-compute[74540]:       <entry name="serial">26890199-c159-45e4-9d69-08497f81d5c2</entry>
Nov 07 04:27:07 user nova-compute[74540]:       <entry name="uuid">26890199-c159-45e4-9d69-08497f81d5c2</entry>
Nov 07 04:27:07 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:27:07 user nova-compute[74540]:     </system>
Nov 07 04:27:07 user nova-compute[74540]:   </sysinfo>
Nov 07 04:27:07 user nova-compute[74540]:   <os>
Nov 07 04:27:07 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:27:07 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:27:07 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:27:07 user nova-compute[74540]:   </os>
Nov 07 04:27:07 user nova-compute[74540]:   <features>
Nov 07 04:27:07 user nova-compute[74540]:     <acpi/>
Nov 07 04:27:07 user nova-compute[74540]:     <apic/>
Nov 07 04:27:07 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:27:07 user nova-compute[74540]:   </features>
Nov 07 04:27:07 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:27:07 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:27:07 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:27:07 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:27:07 user nova-compute[74540]:   </clock>
Nov 07 04:27:07 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:27:07 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:27:07 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:27:07 user nova-compute[74540]:   </cpu>
Nov 07 04:27:07 user nova-compute[74540]:   <devices>
Nov 07 04:27:07 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:27:07 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:27:07 user nova-compute[74540]:       <source dev="/dev/sdd"/>
Nov 07 04:27:07 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:27:07 user nova-compute[74540]:       <serial>7719ba97-3b4a-43e1-96b0-ce5fca24be6a</serial>
Nov 07 04:27:07 user nova-compute[74540]:     </disk>
Nov 07 04:27:07 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:27:07 user nova-compute[74540]:       <mac address="fa:16:3e:0d:12:8f"/>
Nov 07 04:27:07 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:27:07 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:27:07 user nova-compute[74540]:       <target dev="tap7e6e59a5-61"/>
Nov 07 04:27:07 user nova-compute[74540]:     </interface>
Nov 07 04:27:07 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:27:07 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/26890199-c159-45e4-9d69-08497f81d5c2/console.log" append="off"/>
Nov 07 04:27:07 user nova-compute[74540]:     </serial>
Nov 07 04:27:07 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:27:07 user nova-compute[74540]:     <video>
Nov 07 04:27:07 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:27:07 user nova-compute[74540]:     </video>
Nov 07 04:27:07 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:27:07 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:27:07 user nova-compute[74540]:     </rng>
Nov 07 04:27:07 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:27:07 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:27:07 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:27:07 user nova-compute[74540]:     </memballoon>
Nov 07 04:27:07 user nova-compute[74540]:   </devices>
Nov 07 04:27:07 user nova-compute[74540]: </domain>
Nov 07 04:27:07 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-707186112',display_name='tempest-TestShelveInstance-server-707186112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-707186112',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANy3Hf05eA8Uao7ke4zYpDwI2ZJAlLySHnaLwNxrbFZ1mnbZhcv+IFwZq9Hcnhjlrfh/wz5C28+C6yR1LiJlaQPXFaVWzpl1YT74QjHyZN5OUDEqDzeySQfMbDvymXpnw==',key_name='tempest-TestShelveInstance-1395746955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='973e71d3c5dd4e268defadc32013ea39',ramdisk_id='',reservation_id='r-ulrbyx8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1609380101',owner_user_name='tempest-TestShelveInstance-1609380101-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:26:44Z,user_data=None,user_id='15f998264d6c4ddf89f55894400758cb',uuid=26890199-c159-45e4-9d69-08497f81d5c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Converting VIF {"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG os_vif [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6d1bb75-92e1-563d-870a-97a2861d3dae', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e6e59a5-61, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e6e59a5-61, col_values=(('qos', UUID('bed6a12d-93e9-4690-8481-c233163f6611')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e6e59a5-61, col_values=(('external_ids', {'iface-id': '7e6e59a5-614a-4fe8-ab91-bdf847c4209e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:12:8f', 'vm-uuid': '26890199-c159-45e4-9d69-08497f81d5c2'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:07 user nova-compute[74540]: INFO os_vif [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61')
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] No VIF found with MAC fa:16:3e:0d:12:8f, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Skipping network cache update for instance because it is Building. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:27:07 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid bb6c2f59-c949-4df8-a6e4-ed92d7926639 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:27:08 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updating instance_info_cache with network_info: [{"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:27:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-bb6c2f59-c949-4df8-a6e4-ed92d7926639" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:27:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:27:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-e5b00577-d5e4-4eb7-a3d0-885f65c62efa req-390d55b0-6eb2-4fac-867e-13ae45c7d33b service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e5b00577-d5e4-4eb7-a3d0-885f65c62efa req-390d55b0-6eb2-4fac-867e-13ae45c7d33b service nova] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e5b00577-d5e4-4eb7-a3d0-885f65c62efa req-390d55b0-6eb2-4fac-867e-13ae45c7d33b service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e5b00577-d5e4-4eb7-a3d0-885f65c62efa req-390d55b0-6eb2-4fac-867e-13ae45c7d33b service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:08 user nova-compute[74540]: DEBUG nova.compute.manager [req-e5b00577-d5e4-4eb7-a3d0-885f65c62efa req-390d55b0-6eb2-4fac-867e-13ae45c7d33b service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] No waiting events found dispatching network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:27:08 user nova-compute[74540]: WARNING nova.compute.manager [req-e5b00577-d5e4-4eb7-a3d0-885f65c62efa req-390d55b0-6eb2-4fac-867e-13ae45c7d33b service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received unexpected event network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e for instance with vm_state building and task_state spawning.
Nov 07 04:27:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG nova.compute.manager [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:27:10 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Instance spawned successfully.
Nov 07 04:27:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG nova.compute.manager [req-2a224e36-98dd-4294-a493-45f0f20d3df9 req-9837ad81-78e4-423d-86f0-fd6533978415 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-2a224e36-98dd-4294-a493-45f0f20d3df9 req-9837ad81-78e4-423d-86f0-fd6533978415 service nova] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-2a224e36-98dd-4294-a493-45f0f20d3df9 req-9837ad81-78e4-423d-86f0-fd6533978415 service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-2a224e36-98dd-4294-a493-45f0f20d3df9 req-9837ad81-78e4-423d-86f0-fd6533978415 service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:10 user nova-compute[74540]: DEBUG nova.compute.manager [req-2a224e36-98dd-4294-a493-45f0f20d3df9 req-9837ad81-78e4-423d-86f0-fd6533978415 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] No waiting events found dispatching network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:27:10 user nova-compute[74540]: WARNING nova.compute.manager [req-2a224e36-98dd-4294-a493-45f0f20d3df9 req-9837ad81-78e4-423d-86f0-fd6533978415 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received unexpected event network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e for instance with vm_state building and task_state spawning.
Nov 07 04:27:10 user nova-compute[74540]: INFO nova.compute.manager [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 07 04:27:10 user nova-compute[74540]: DEBUG nova.compute.manager [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:27:11 user nova-compute[74540]: INFO nova.compute.manager [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Took 27.73 seconds to build instance.
Nov 07 04:27:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-30efc2e3-3ab4-4b9b-bfe1-374f5457a39c tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "26890199-c159-45e4-9d69-08497f81d5c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.838s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:13 user nova-compute[74540]: DEBUG nova.compute.manager [req-697cc2a5-d1a3-4ea8-8ec5-c891a84ebe3a req-384c7687-b4d9-4f00-9afb-846b6f3ec069 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-changed-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:13 user nova-compute[74540]: DEBUG nova.compute.manager [req-697cc2a5-d1a3-4ea8-8ec5-c891a84ebe3a req-384c7687-b4d9-4f00-9afb-846b6f3ec069 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Refreshing instance network info cache due to event network-changed-356a2bea-a767-4948-b7f5-3f1871db48f0. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:27:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-697cc2a5-d1a3-4ea8-8ec5-c891a84ebe3a req-384c7687-b4d9-4f00-9afb-846b6f3ec069 service nova] Acquiring lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:27:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-697cc2a5-d1a3-4ea8-8ec5-c891a84ebe3a req-384c7687-b4d9-4f00-9afb-846b6f3ec069 service nova] Acquired lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:27:13 user nova-compute[74540]: DEBUG nova.network.neutron [req-697cc2a5-d1a3-4ea8-8ec5-c891a84ebe3a req-384c7687-b4d9-4f00-9afb-846b6f3ec069 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Refreshing network info cache for port 356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:27:13 user nova-compute[74540]: DEBUG nova.network.neutron [req-697cc2a5-d1a3-4ea8-8ec5-c891a84ebe3a req-384c7687-b4d9-4f00-9afb-846b6f3ec069 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updated VIF entry in instance network info cache for port 356a2bea-a767-4948-b7f5-3f1871db48f0. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:27:13 user nova-compute[74540]: DEBUG nova.network.neutron [req-697cc2a5-d1a3-4ea8-8ec5-c891a84ebe3a req-384c7687-b4d9-4f00-9afb-846b6f3ec069 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updating instance_info_cache with network_info: [{"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:27:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-697cc2a5-d1a3-4ea8-8ec5-c891a84ebe3a req-384c7687-b4d9-4f00-9afb-846b6f3ec069 service nova] Releasing lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:27:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-b1b2bce2-7cec-4bce-b3fe-4a09656ce334 req-292b34ac-d9e9-4dc4-8e11-b1d3c1d4783c service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-changed-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:15 user nova-compute[74540]: DEBUG nova.compute.manager [req-b1b2bce2-7cec-4bce-b3fe-4a09656ce334 req-292b34ac-d9e9-4dc4-8e11-b1d3c1d4783c service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Refreshing instance network info cache due to event network-changed-356a2bea-a767-4948-b7f5-3f1871db48f0. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:27:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b1b2bce2-7cec-4bce-b3fe-4a09656ce334 req-292b34ac-d9e9-4dc4-8e11-b1d3c1d4783c service nova] Acquiring lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:27:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b1b2bce2-7cec-4bce-b3fe-4a09656ce334 req-292b34ac-d9e9-4dc4-8e11-b1d3c1d4783c service nova] Acquired lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:27:15 user nova-compute[74540]: DEBUG nova.network.neutron [req-b1b2bce2-7cec-4bce-b3fe-4a09656ce334 req-292b34ac-d9e9-4dc4-8e11-b1d3c1d4783c service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Refreshing network info cache for port 356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:27:15 user nova-compute[74540]: DEBUG nova.network.neutron [req-b1b2bce2-7cec-4bce-b3fe-4a09656ce334 req-292b34ac-d9e9-4dc4-8e11-b1d3c1d4783c service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updated VIF entry in instance network info cache for port 356a2bea-a767-4948-b7f5-3f1871db48f0. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:27:15 user nova-compute[74540]: DEBUG nova.network.neutron [req-b1b2bce2-7cec-4bce-b3fe-4a09656ce334 req-292b34ac-d9e9-4dc4-8e11-b1d3c1d4783c service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updating instance_info_cache with network_info: [{"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:27:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b1b2bce2-7cec-4bce-b3fe-4a09656ce334 req-292b34ac-d9e9-4dc4-8e11-b1d3c1d4783c service nova] Releasing lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:27:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:26 user nova-compute[74540]: INFO nova.compute.manager [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Rebooting instance
Nov 07 04:27:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquired lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updating instance_info_cache with network_info: [{"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Releasing lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-bd5e842f-3cf8-4566-96cc-8f2f180b5d41 req-e976b0bd-0cee-4cc1-bb33-730d02c681b5 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-vif-unplugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bd5e842f-3cf8-4566-96cc-8f2f180b5d41 req-e976b0bd-0cee-4cc1-bb33-730d02c681b5 service nova] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bd5e842f-3cf8-4566-96cc-8f2f180b5d41 req-e976b0bd-0cee-4cc1-bb33-730d02c681b5 service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bd5e842f-3cf8-4566-96cc-8f2f180b5d41 req-e976b0bd-0cee-4cc1-bb33-730d02c681b5 service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-bd5e842f-3cf8-4566-96cc-8f2f180b5d41 req-e976b0bd-0cee-4cc1-bb33-730d02c681b5 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] No waiting events found dispatching network-vif-unplugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:27:27 user nova-compute[74540]: WARNING nova.compute.manager [req-bd5e842f-3cf8-4566-96cc-8f2f180b5d41 req-e976b0bd-0cee-4cc1-bb33-730d02c681b5 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received unexpected event network-vif-unplugged-356a2bea-a767-4948-b7f5-3f1871db48f0 for instance with vm_state active and task_state reboot_started_hard.
Nov 07 04:27:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:27 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Instance destroyed successfully.
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'resources' on Instance uuid 7ea40dee-8c35-4508-a8c1-34772281aa15 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1823291217',display_name='tempest-TestMinimumBasicScenario-server-1823291217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1823291217',id=41,image_ref='b4dd7e24-5719-46fc-be3b-c2b15e7a318a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZ5g6Rw23CRhXshdRlt3kBkQr87DRjsdcdtrFVqa3XSLXtWNb0bH/ZdAzkAy0kffcjbYZ+/V+DIhpBa4kXn4wMwWewFeUAaDJqnWuMnJb2JgVCLnX36JI+9j7zR3ryXcw==',key_name='tempest-TestMinimumBasicScenario-872081033',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:24:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92bc5f60b66347ca8404e1553ec719d7',ramdisk_id='',reservation_id='r-rw8uyp2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dd7e24-5719-46fc-be3b-c2b15e7a318a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-702707071',owner_user_name='tempest-TestMinimumBasicScenario-702707071-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:27:27Z,user_data=None,user_id='48997d7730cb406dbf7d127224a52543',uuid=7ea40dee-8c35-4508-a8c1-34772281aa15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converting VIF {"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_vif [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap356a2bea-a7, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ccfae99-971d-42aa-a317-743fc6501f82) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:27:27 user nova-compute[74540]: INFO os_vif [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7')
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUDCLiag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:27:27 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a9b1c1-f5cf-4e6b-96be-b1a0be0fc18f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:27:27 user nova-compute[74540]: No targets found.
Nov 07 04:27:27 user nova-compute[74540]: iSNS:
Nov 07 04:27:27 user nova-compute[74540]: No targets found.
Nov 07 04:27:27 user nova-compute[74540]: STATIC:
Nov 07 04:27:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a
Nov 07 04:27:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:27:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:27:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7
Nov 07 04:27:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:27:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:27:27 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:27:27 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:27:27 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:27:27 user nova-compute[74540]: FIRMWARE:
Nov 07 04:27:27 user nova-compute[74540]: No targets found.
Nov 07 04:27:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:27:27 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:27:27 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beca087-dafc-493d-9e3a-5b43dc5ba0e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[edded398-7a83-40a6-83c3-891f5f6615c3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:27:27 user nova-compute[74540]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:27:27 user nova-compute[74540]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:27:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:27:27 user nova-compute[74540]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:27:27 user nova-compute[74540]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:27:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee1c1e0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0143b7-2992-45ca-8c1b-c5a7a4f0f541]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f89036d-0b6d-4b99-83ac-7b5d1d127938]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5756c5fb-25d9-4ff0-a4cc-241cf3c4ca37]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5d0a19-2122-4dce-ad72-89544808be5f]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d38a8e4-afeb-4e3b-afbe-c5a6fdc203c6]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1a0e58-e3d2-4a75-aa5d-f4ca6eee4d1e]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260]
Nov 07 04:27:27 user nova-compute[74540]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260] successful.
Nov 07 04:27:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee1e3d0-1424-415a-aff9-847eebc4e150]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] <== disconnect_volume: return (309ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Start _get_guest_xml network_info=[{"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4dd7e24-5719-46fc-be3b-c2b15e7a318a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b4dd7e24-5719-46fc-be3b-c2b15e7a318a'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUDCLiag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7ea40dee-8c35-4508-a8c1-34772281aa15', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3cb1bfa-ea57-4213-b444-65ee81deebf7', 'serial': 'b3cb1bfa-ea57-4213-b444-65ee81deebf7'}, 'boot_index': None, 'attachment_id': '99c7f8a2-efee-44e5-817a-0afb308fa042', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:27:27 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:27:27 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b4dd7e24-5719-46fc-be3b-c2b15e7a318a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ea40dee-8c35-4508-a8c1-34772281aa15 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.objects.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Object Instance<7ea40dee-8c35-4508-a8c1-34772281aa15> lazy-loaded attributes: resources,vcpu_model {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUDCLiag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:27:27 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:27:27 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:27:27 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[347bd7c9-d216-4ac5-9a5b-7f6df8147088]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:27:27 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0834b117-d97d-47a2-bdca-b5fc771f639b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7] added
Nov 07 04:27:27 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[837435b2-4bc9-4b99-b75d-a2987a32e5e2]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f7a630-c080-472a-9dd2-35f7a8edd8ba]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUDCLiag {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUDCLiag" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b238ed4-cc7b-440f-80e5-1b7192ba268f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JUDCLiag'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee399ea0-2ad8-4a73-8dec-72cca75b572f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[691f3663-0c9a-46ac-9137-b6d55ec90233]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:27:28 user nova-compute[74540]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:27:28 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:27:28 user nova-compute[74540]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:27:28 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c63038-8300-4457-a5db-ea2ec0521720]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260]
Nov 07 04:27:28 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260] successful.
Nov 07 04:27:28 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1557e8e-831e-4070-a3d2-e72b204e979f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c6af83-2270-4289-ba64-33e842a21a11]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:27:28 user nova-compute[74540]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:27:28 user nova-compute[74540]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:27:28 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:27:28 user nova-compute[74540]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:27:28 user nova-compute[74540]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:27:28 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd34bbc-9705-4ceb-be33-037ffa55fb02]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:28 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-5897acf8-2f03-40f7-a899-a2c88dc02ab8 req-a39961e1-0df6-4736-8d9b-625bee6559b7 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5897acf8-2f03-40f7-a899-a2c88dc02ab8 req-a39961e1-0df6-4736-8d9b-625bee6559b7 service nova] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5897acf8-2f03-40f7-a899-a2c88dc02ab8 req-a39961e1-0df6-4736-8d9b-625bee6559b7 service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5897acf8-2f03-40f7-a899-a2c88dc02ab8 req-a39961e1-0df6-4736-8d9b-625bee6559b7 service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG nova.compute.manager [req-5897acf8-2f03-40f7-a899-a2c88dc02ab8 req-a39961e1-0df6-4736-8d9b-625bee6559b7 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] No waiting events found dispatching network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:27:29 user nova-compute[74540]: WARNING nova.compute.manager [req-5897acf8-2f03-40f7-a899-a2c88dc02ab8 req-a39961e1-0df6-4736-8d9b-625bee6559b7 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received unexpected event network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 for instance with vm_state active and task_state reboot_started_hard.
Nov 07 04:27:29 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUDCLiag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26166616463653639', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166616463653639', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1823291217',display_name='tempest-TestMinimumBasicScenario-server-1823291217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1823291217',id=41,image_ref='b4dd7e24-5719-46fc-be3b-c2b15e7a318a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZ5g6Rw23CRhXshdRlt3kBkQr87DRjsdcdtrFVqa3XSLXtWNb0bH/ZdAzkAy0kffcjbYZ+/V+DIhpBa4kXn4wMwWewFeUAaDJqnWuMnJb2JgVCLnX36JI+9j7zR3ryXcw==',key_name='tempest-TestMinimumBasicScenario-872081033',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:24:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92bc5f60b66347ca8404e1553ec719d7',ramdisk_id='',reservation_id='r-rw8uyp2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dd7e24-5719-46fc-be3b-c2b15e7a318a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-702707071',owner_user_name='tempest-TestMinimumBasicScenario-702707071-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:27:27Z,user_data=None,user_id='48997d7730cb406dbf7d127224a52543',uuid=7ea40dee-8c35-4508-a8c1-34772281aa15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converting VIF {"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ea40dee-8c35-4508-a8c1-34772281aa15 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG nova.objects.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Object Instance<7ea40dee-8c35-4508-a8c1-34772281aa15> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:27:29 user nova-compute[74540]:   <uuid>7ea40dee-8c35-4508-a8c1-34772281aa15</uuid>
Nov 07 04:27:29 user nova-compute[74540]:   <name>instance-00000029</name>
Nov 07 04:27:29 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:27:29 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:27:29 user nova-compute[74540]:   <metadata>
Nov 07 04:27:29 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:27:29 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:27:29 user nova-compute[74540]:       <nova:name>tempest-TestMinimumBasicScenario-server-1823291217</nova:name>
Nov 07 04:27:29 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:27:27</nova:creationTime>
Nov 07 04:27:29 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:27:29 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:27:29 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:27:29 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:27:29 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:27:29 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:27:29 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:27:29 user nova-compute[74540]:       <nova:owner>
Nov 07 04:27:29 user nova-compute[74540]:         <nova:user uuid="48997d7730cb406dbf7d127224a52543">tempest-TestMinimumBasicScenario-702707071-project-member</nova:user>
Nov 07 04:27:29 user nova-compute[74540]:         <nova:project uuid="92bc5f60b66347ca8404e1553ec719d7">tempest-TestMinimumBasicScenario-702707071</nova:project>
Nov 07 04:27:29 user nova-compute[74540]:       </nova:owner>
Nov 07 04:27:29 user nova-compute[74540]:       <nova:root type="image" uuid="b4dd7e24-5719-46fc-be3b-c2b15e7a318a"/>
Nov 07 04:27:29 user nova-compute[74540]:       <nova:ports>
Nov 07 04:27:29 user nova-compute[74540]:         <nova:port uuid="356a2bea-a767-4948-b7f5-3f1871db48f0">
Nov 07 04:27:29 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 04:27:29 user nova-compute[74540]:         </nova:port>
Nov 07 04:27:29 user nova-compute[74540]:       </nova:ports>
Nov 07 04:27:29 user nova-compute[74540]:     </nova:instance>
Nov 07 04:27:29 user nova-compute[74540]:   </metadata>
Nov 07 04:27:29 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:27:29 user nova-compute[74540]:     <system>
Nov 07 04:27:29 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:27:29 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:27:29 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:27:29 user nova-compute[74540]:       <entry name="serial">7ea40dee-8c35-4508-a8c1-34772281aa15</entry>
Nov 07 04:27:29 user nova-compute[74540]:       <entry name="uuid">7ea40dee-8c35-4508-a8c1-34772281aa15</entry>
Nov 07 04:27:29 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:27:29 user nova-compute[74540]:     </system>
Nov 07 04:27:29 user nova-compute[74540]:   </sysinfo>
Nov 07 04:27:29 user nova-compute[74540]:   <os>
Nov 07 04:27:29 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:27:29 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:27:29 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:27:29 user nova-compute[74540]:   </os>
Nov 07 04:27:29 user nova-compute[74540]:   <features>
Nov 07 04:27:29 user nova-compute[74540]:     <acpi/>
Nov 07 04:27:29 user nova-compute[74540]:     <apic/>
Nov 07 04:27:29 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:27:29 user nova-compute[74540]:   </features>
Nov 07 04:27:29 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:27:29 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:27:29 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:27:29 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:27:29 user nova-compute[74540]:   </clock>
Nov 07 04:27:29 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:27:29 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:27:29 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:27:29 user nova-compute[74540]:   </cpu>
Nov 07 04:27:29 user nova-compute[74540]:   <devices>
Nov 07 04:27:29 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:27:29 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:27:29 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk"/>
Nov 07 04:27:29 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:27:29 user nova-compute[74540]:     </disk>
Nov 07 04:27:29 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:27:29 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:27:29 user nova-compute[74540]:       <source dev="/dev/sdc"/>
Nov 07 04:27:29 user nova-compute[74540]:       <target dev="vdb" bus="virtio"/>
Nov 07 04:27:29 user nova-compute[74540]:       <serial>b3cb1bfa-ea57-4213-b444-65ee81deebf7</serial>
Nov 07 04:27:29 user nova-compute[74540]:     </disk>
Nov 07 04:27:29 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:27:29 user nova-compute[74540]:       <mac address="fa:16:3e:52:b2:6e"/>
Nov 07 04:27:29 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:27:29 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:27:29 user nova-compute[74540]:       <target dev="tap356a2bea-a7"/>
Nov 07 04:27:29 user nova-compute[74540]:     </interface>
Nov 07 04:27:29 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:27:29 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/console.log" append="off"/>
Nov 07 04:27:29 user nova-compute[74540]:     </serial>
Nov 07 04:27:29 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:27:29 user nova-compute[74540]:     <video>
Nov 07 04:27:29 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:27:29 user nova-compute[74540]:     </video>
Nov 07 04:27:29 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:27:29 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:27:29 user nova-compute[74540]:     </rng>
Nov 07 04:27:29 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:27:29 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:27:29 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:27:29 user nova-compute[74540]:     </memballoon>
Nov 07 04:27:29 user nova-compute[74540]:   </devices>
Nov 07 04:27:29 user nova-compute[74540]: </domain>
Nov 07 04:27:29 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ea40dee-8c35-4508-a8c1-34772281aa15 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG nova.objects.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Object Instance<7ea40dee-8c35-4508-a8c1-34772281aa15> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:27:29 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Cannot resize image /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'migration_context' on Instance uuid 7ea40dee-8c35-4508-a8c1-34772281aa15 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG nova.objects.base [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Object Instance<7ea40dee-8c35-4508-a8c1-34772281aa15> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1823291217',display_name='tempest-TestMinimumBasicScenario-server-1823291217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1823291217',id=41,image_ref='b4dd7e24-5719-46fc-be3b-c2b15e7a318a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZ5g6Rw23CRhXshdRlt3kBkQr87DRjsdcdtrFVqa3XSLXtWNb0bH/ZdAzkAy0kffcjbYZ+/V+DIhpBa4kXn4wMwWewFeUAaDJqnWuMnJb2JgVCLnX36JI+9j7zR3ryXcw==',key_name='tempest-TestMinimumBasicScenario-872081033',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:24:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='92bc5f60b66347ca8404e1553ec719d7',ramdisk_id='',reservation_id='r-rw8uyp2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dd7e24-5719-46fc-be3b-c2b15e7a318a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-702707071',owner_user_name='tempest-TestMinimumBasicScenario-702707071-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:27:27Z,user_data=None,user_id='48997d7730cb406dbf7d127224a52543',uuid=7ea40dee-8c35-4508-a8c1-34772281aa15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converting VIF {"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG os_vif [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9105a4c4-d243-5379-ab28-f47170a2ee33', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap356a2bea-a7, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap356a2bea-a7, col_values=(('qos', UUID('2494efd5-743c-4e05-aea7-3c70de1698da')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap356a2bea-a7, col_values=(('external_ids', {'iface-id': '356a2bea-a767-4948-b7f5-3f1871db48f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:b2:6e', 'vm-uuid': '7ea40dee-8c35-4508-a8c1-34772281aa15'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:27:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:30 user nova-compute[74540]: INFO os_vif [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7')
Nov 07 04:27:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-c1478f7b-4d1d-4c4a-bea2-7c8005ff14be req-11065521-7045-403a-b1a7-e0665d2cb8e4 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c1478f7b-4d1d-4c4a-bea2-7c8005ff14be req-11065521-7045-403a-b1a7-e0665d2cb8e4 service nova] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c1478f7b-4d1d-4c4a-bea2-7c8005ff14be req-11065521-7045-403a-b1a7-e0665d2cb8e4 service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c1478f7b-4d1d-4c4a-bea2-7c8005ff14be req-11065521-7045-403a-b1a7-e0665d2cb8e4 service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-c1478f7b-4d1d-4c4a-bea2-7c8005ff14be req-11065521-7045-403a-b1a7-e0665d2cb8e4 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] No waiting events found dispatching network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:27:31 user nova-compute[74540]: WARNING nova.compute.manager [req-c1478f7b-4d1d-4c4a-bea2-7c8005ff14be req-11065521-7045-403a-b1a7-e0665d2cb8e4 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received unexpected event network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 for instance with vm_state active and task_state reboot_started_hard.
Nov 07 04:27:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:33 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:27:33 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Instance rebooted successfully.
Nov 07 04:27:33 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:27:33 user nova-compute[74540]: DEBUG nova.compute.manager [req-1eddb0f6-ffb0-4ae7-8d46-843fce0dc11c req-38f7b452-7110-488e-a8e1-f41abd7d4636 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1eddb0f6-ffb0-4ae7-8d46-843fce0dc11c req-38f7b452-7110-488e-a8e1-f41abd7d4636 service nova] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1eddb0f6-ffb0-4ae7-8d46-843fce0dc11c req-38f7b452-7110-488e-a8e1-f41abd7d4636 service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1eddb0f6-ffb0-4ae7-8d46-843fce0dc11c req-38f7b452-7110-488e-a8e1-f41abd7d4636 service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:33 user nova-compute[74540]: DEBUG nova.compute.manager [req-1eddb0f6-ffb0-4ae7-8d46-843fce0dc11c req-38f7b452-7110-488e-a8e1-f41abd7d4636 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] No waiting events found dispatching network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:27:33 user nova-compute[74540]: WARNING nova.compute.manager [req-1eddb0f6-ffb0-4ae7-8d46-843fce0dc11c req-38f7b452-7110-488e-a8e1-f41abd7d4636 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received unexpected event network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 for instance with vm_state active and task_state reboot_started_hard.
Nov 07 04:27:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f1ec7204-5d4f-49d4-9752-01824ae3562b tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.847s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:34 user nova-compute[74540]: INFO nova.compute.manager [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Terminating instance
Nov 07 04:27:34 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:27:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG nova.compute.manager [req-bf07bbff-b919-4365-b373-f8c6e2e0ed68 req-ea943aab-089e-462e-949f-88851b4aa181 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-unplugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bf07bbff-b919-4365-b373-f8c6e2e0ed68 req-ea943aab-089e-462e-949f-88851b4aa181 service nova] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bf07bbff-b919-4365-b373-f8c6e2e0ed68 req-ea943aab-089e-462e-949f-88851b4aa181 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bf07bbff-b919-4365-b373-f8c6e2e0ed68 req-ea943aab-089e-462e-949f-88851b4aa181 service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG nova.compute.manager [req-bf07bbff-b919-4365-b373-f8c6e2e0ed68 req-ea943aab-089e-462e-949f-88851b4aa181 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] No waiting events found dispatching network-vif-unplugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG nova.compute.manager [req-bf07bbff-b919-4365-b373-f8c6e2e0ed68 req-ea943aab-089e-462e-949f-88851b4aa181 service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-unplugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:35 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Instance destroyed successfully.
Nov 07 04:27:35 user nova-compute[74540]: DEBUG nova.objects.instance [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'resources' on Instance uuid ac4742cd-822a-43b1-adc7-4c7452bd0e35 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-183391627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-183391627',id=27,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:12:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-yoku2v0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:14:43Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=ac4742cd-822a-43b1-adc7-4c7452bd0e35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "address": "fa:16:3e:0e:58:23", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cbc02f-e0", "ovs_interfaceid": "d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:58:23,bridge_name='br-int',has_traffic_filtering=True,id=d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cbc02f-e0') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_vif [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:58:23,bridge_name='br-int',has_traffic_filtering=True,id=d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cbc02f-e0') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0cbc02f-e0, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a1553df-eb84-447d-a218-fab5c56b1520) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:35 user nova-compute[74540]: INFO os_vif [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:58:23,bridge_name='br-int',has_traffic_filtering=True,id=d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cbc02f-e0')
Nov 07 04:27:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVHNEMTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:27:35 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad74e2c8-d671-4b15-8685-a831bb705d97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:27:35 user nova-compute[74540]: No targets found.
Nov 07 04:27:35 user nova-compute[74540]: iSNS:
Nov 07 04:27:35 user nova-compute[74540]: No targets found.
Nov 07 04:27:35 user nova-compute[74540]: STATIC:
Nov 07 04:27:35 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a
Nov 07 04:27:35 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:27:35 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:27:35 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7
Nov 07 04:27:35 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:27:35 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:27:35 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527
Nov 07 04:27:35 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:27:35 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:27:35 user nova-compute[74540]: FIRMWARE:
Nov 07 04:27:35 user nova-compute[74540]: No targets found.
Nov 07 04:27:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:27:35 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:27:35 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[20568581-d596-4188-8817-8f50cf3ea005]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d44210c-7ca4-426a-b7b5-f4d69e1a1f54]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:27:35 user nova-compute[74540]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:27:35 user nova-compute[74540]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:27:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 (non-flash)
Nov 07 04:27:35 user nova-compute[74540]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:27:35 user nova-compute[74540]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:27:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc686b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a8e579-f100-4d53-9f3d-d107b56eebc7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbf2856-5222-48fc-b27e-3fe9331e146a]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cffb49-3a90-4885-884a-85e739672c5d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f86faeb-3e78-4615-8af5-36a017ab0b05]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[244b6c6f-230f-41be-86a3-3bfe6834c0c1]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[826679e5-adae-41ba-9b60-5317c85b0d95]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527, portal: 172.16.0.220,3260]
Nov 07 04:27:35 user nova-compute[74540]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527, portal: 172.16.0.220,3260] successful.
Nov 07 04:27:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35a7a6dd-6cc6-4528-b0fd-172e6a6b5527 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f75c20e-c493-40ef-a73d-f90a342d1531]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] <== disconnect_volume: return (370ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:27:35 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Deleting instance files /opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35_del
Nov 07 04:27:35 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Deletion of /opt/stack/data/nova/instances/ac4742cd-822a-43b1-adc7-4c7452bd0e35_del complete
Nov 07 04:27:35 user nova-compute[74540]: INFO nova.compute.manager [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 07 04:27:35 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:27:35 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:27:36 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:27:36 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Took 0.52 seconds to deallocate network for instance.
Nov 07 04:27:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-ffabb8ec-9dff-4615-b2d3-a4f8cce6d37d req-287b0690-a1b8-489c-8e35-94b3f8c53b0f service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ffabb8ec-9dff-4615-b2d3-a4f8cce6d37d req-287b0690-a1b8-489c-8e35-94b3f8c53b0f service nova] Acquiring lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ffabb8ec-9dff-4615-b2d3-a4f8cce6d37d req-287b0690-a1b8-489c-8e35-94b3f8c53b0f service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ffabb8ec-9dff-4615-b2d3-a4f8cce6d37d req-287b0690-a1b8-489c-8e35-94b3f8c53b0f service nova] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-ffabb8ec-9dff-4615-b2d3-a4f8cce6d37d req-287b0690-a1b8-489c-8e35-94b3f8c53b0f service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] No waiting events found dispatching network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:27:37 user nova-compute[74540]: WARNING nova.compute.manager [req-ffabb8ec-9dff-4615-b2d3-a4f8cce6d37d req-287b0690-a1b8-489c-8e35-94b3f8c53b0f service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received unexpected event network-vif-plugged-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 for instance with vm_state active and task_state deleting.
Nov 07 04:27:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-ffabb8ec-9dff-4615-b2d3-a4f8cce6d37d req-287b0690-a1b8-489c-8e35-94b3f8c53b0f service nova] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Received event network-vif-deleted-d0cbc02f-e0a3-4fb9-a34e-96cc6898ef22 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:45 user nova-compute[74540]: INFO nova.compute.manager [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: ac4742cd-822a-43b1-adc7-4c7452bd0e35] Took 9.53 seconds to detach 1 volumes for instance.
Nov 07 04:27:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:46 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:27:46 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:27:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:46 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Deleted allocations for instance ac4742cd-822a-43b1-adc7-4c7452bd0e35
Nov 07 04:27:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5cf85fbf-0a09-494a-878e-ac3c0407172c tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "ac4742cd-822a-43b1-adc7-4c7452bd0e35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.910s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:46 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:27:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:49 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:27:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:52 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Acquiring lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Acquiring lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:53 user nova-compute[74540]: INFO nova.compute.manager [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Terminating instance
Nov 07 04:27:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e2428e-a46d-46bc-9304-a0575995bcbc req-099ab95c-5137-40c8-9e5f-471a6c159e1c service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Received event network-vif-unplugged-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e2428e-a46d-46bc-9304-a0575995bcbc req-099ab95c-5137-40c8-9e5f-471a6c159e1c service nova] Acquiring lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e2428e-a46d-46bc-9304-a0575995bcbc req-099ab95c-5137-40c8-9e5f-471a6c159e1c service nova] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-41e2428e-a46d-46bc-9304-a0575995bcbc req-099ab95c-5137-40c8-9e5f-471a6c159e1c service nova] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e2428e-a46d-46bc-9304-a0575995bcbc req-099ab95c-5137-40c8-9e5f-471a6c159e1c service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] No waiting events found dispatching network-vif-unplugged-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-41e2428e-a46d-46bc-9304-a0575995bcbc req-099ab95c-5137-40c8-9e5f-471a6c159e1c service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Received event network-vif-unplugged-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:27:53 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:27:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Instance destroyed successfully.
Nov 07 04:27:53 user nova-compute[74540]: DEBUG nova.objects.instance [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lazy-loading 'resources' on Instance uuid fab2c59a-7b98-4704-a4bf-d9fa8d714b16 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1980235109',display_name='tempest-VolumesNegativeTest-instance-1980235109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1980235109',id=42,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:26:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f3744c755f444d69769b2e0f8edcd12',ramdisk_id='',reservation_id='r-2bjg5uks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-150463387',owner_user_name='tempest-VolumesNegativeTest-150463387-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:26:09Z,user_data=None,user_id='089b27c6b06c428487098f5d1121fa14',uuid=fab2c59a-7b98-4704-a4bf-d9fa8d714b16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "address": "fa:16:3e:df:bc:42", "network": {"id": "10169c69-19d4-46fc-9ef7-cde9c7d58a42", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85e4cd2fa8e74df0a62d09de21e82a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02ce80b-b7", "ovs_interfaceid": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Converting VIF {"id": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "address": "fa:16:3e:df:bc:42", "network": {"id": "10169c69-19d4-46fc-9ef7-cde9c7d58a42", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "85e4cd2fa8e74df0a62d09de21e82a60", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02ce80b-b7", "ovs_interfaceid": "f02ce80b-b71d-4f79-ad8a-929aa0ca1e04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=f02ce80b-b71d-4f79-ad8a-929aa0ca1e04,network=Network(10169c69-19d4-46fc-9ef7-cde9c7d58a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02ce80b-b7') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG os_vif [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=f02ce80b-b71d-4f79-ad8a-929aa0ca1e04,network=Network(10169c69-19d4-46fc-9ef7-cde9c7d58a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02ce80b-b7') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf02ce80b-b7, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78b0aaa4-7103-4609-ba88-1cd7afd1c15e) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:27:54 user nova-compute[74540]: INFO os_vif [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:bc:42,bridge_name='br-int',has_traffic_filtering=True,id=f02ce80b-b71d-4f79-ad8a-929aa0ca1e04,network=Network(10169c69-19d4-46fc-9ef7-cde9c7d58a42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02ce80b-b7')
Nov 07 04:27:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Deleting instance files /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16_del
Nov 07 04:27:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Deletion of /opt/stack/data/nova/instances/fab2c59a-7b98-4704-a4bf-d9fa8d714b16_del complete
Nov 07 04:27:54 user nova-compute[74540]: INFO nova.compute.manager [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 07 04:27:54 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:27:54 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Took 0.81 seconds to deallocate network for instance.
Nov 07 04:27:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-bf0498e4-f473-449f-ba4d-a8a4e8fae578 req-d60b06a0-6d09-47a0-bf04-eeb03b72489e service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Received event network-vif-deleted-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:55 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:27:55 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:27:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:55 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Deleted allocations for instance fab2c59a-7b98-4704-a4bf-d9fa8d714b16
Nov 07 04:27:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-fe246b6d-71c3-4a5f-a396-ef7703a32dec tempest-VolumesNegativeTest-150463387 tempest-VolumesNegativeTest-150463387-project-member] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.145s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-c7a50e19-24f4-4ca2-8dfa-2663e386d2df req-db223a28-d499-40d3-bb99-4af5e8f3c724 service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Received event network-vif-plugged-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:27:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7a50e19-24f4-4ca2-8dfa-2663e386d2df req-db223a28-d499-40d3-bb99-4af5e8f3c724 service nova] Acquiring lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:27:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7a50e19-24f4-4ca2-8dfa-2663e386d2df req-db223a28-d499-40d3-bb99-4af5e8f3c724 service nova] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:27:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c7a50e19-24f4-4ca2-8dfa-2663e386d2df req-db223a28-d499-40d3-bb99-4af5e8f3c724 service nova] Lock "fab2c59a-7b98-4704-a4bf-d9fa8d714b16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:27:55 user nova-compute[74540]: DEBUG nova.compute.manager [req-c7a50e19-24f4-4ca2-8dfa-2663e386d2df req-db223a28-d499-40d3-bb99-4af5e8f3c724 service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] No waiting events found dispatching network-vif-plugged-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:27:55 user nova-compute[74540]: WARNING nova.compute.manager [req-c7a50e19-24f4-4ca2-8dfa-2663e386d2df req-db223a28-d499-40d3-bb99-4af5e8f3c724 service nova] [instance: fab2c59a-7b98-4704-a4bf-d9fa8d714b16] Received unexpected event network-vif-plugged-f02ce80b-b71d-4f79-ad8a-929aa0ca1e04 for instance with vm_state deleted and task_state None.
Nov 07 04:27:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:27:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:27:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:27:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:27:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74540) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 04:27:58 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:27:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:27:59 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:28:00 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:28:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:28:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:28:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:28:00 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:28:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:28:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:28:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:02 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:28:02 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8541MB free_disk=24.728443145751953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 7ea40dee-8c35-4508-a8c1-34772281aa15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 26890199-c159-45e4-9d69-08497f81d5c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing inventories for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating ProviderTree inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing aggregate associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, aggregates: None {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing trait associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.582s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 04:28:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] There are 0 instances to clean {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 04:28:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:05 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:28:05 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:28:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:28:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:28:05 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:28:06 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updating instance_info_cache with network_info: [{"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:28:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:28:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:28:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:28:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:28:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:28:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:28:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:28:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:28:25 user nova-compute[74540]: INFO nova.compute.manager [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Terminating instance
Nov 07 04:28:25 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-270ae656-d3e9-4c7e-bae4-f02ee3c8cc1d req-568df99f-c20e-4858-bbdd-bd0950190374 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Received event network-vif-unplugged-a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-270ae656-d3e9-4c7e-bae4-f02ee3c8cc1d req-568df99f-c20e-4858-bbdd-bd0950190374 service nova] Acquiring lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-270ae656-d3e9-4c7e-bae4-f02ee3c8cc1d req-568df99f-c20e-4858-bbdd-bd0950190374 service nova] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-270ae656-d3e9-4c7e-bae4-f02ee3c8cc1d req-568df99f-c20e-4858-bbdd-bd0950190374 service nova] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-270ae656-d3e9-4c7e-bae4-f02ee3c8cc1d req-568df99f-c20e-4858-bbdd-bd0950190374 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] No waiting events found dispatching network-vif-unplugged-a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG nova.compute.manager [req-270ae656-d3e9-4c7e-bae4-f02ee3c8cc1d req-568df99f-c20e-4858-bbdd-bd0950190374 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Received event network-vif-unplugged-a666b729-73b7-4953-871d-fa236a4dd3f0 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:28:25 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Instance destroyed successfully.
Nov 07 04:28:25 user nova-compute[74540]: DEBUG nova.objects.instance [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lazy-loading 'resources' on Instance uuid bb6c2f59-c949-4df8-a6e4-ed92d7926639 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:07:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-767517572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-767517572',id=23,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:07:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='438cd05cbdb34608940422562ba150c8',ramdisk_id='',reservation_id='r-a9gdx7mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:09:04Z,user_data=None,user_id='99ba0f9acca84cdb8cf90c4b313e1b7c',uuid=bb6c2f59-c949-4df8-a6e4-ed92d7926639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converting VIF {"id": "a666b729-73b7-4953-871d-fa236a4dd3f0", "address": "fa:16:3e:94:0f:94", "network": {"id": "f5339bc1-0d4d-4094-a240-6dfd04f08ccf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-552881981-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "438cd05cbdb34608940422562ba150c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa666b729-73", "ovs_interfaceid": "a666b729-73b7-4953-871d-fa236a4dd3f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=a666b729-73b7-4953-871d-fa236a4dd3f0,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa666b729-73') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG os_vif [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=a666b729-73b7-4953-871d-fa236a4dd3f0,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa666b729-73') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa666b729-73, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70cde111-1a1b-4fda-a9f9-b6c50d042bcb) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:25 user nova-compute[74540]: INFO os_vif [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:0f:94,bridge_name='br-int',has_traffic_filtering=True,id=a666b729-73b7-4953-871d-fa236a4dd3f0,network=Network(f5339bc1-0d4d-4094-a240-6dfd04f08ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa666b729-73')
Nov 07 04:28:25 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Deleting instance files /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639_del
Nov 07 04:28:25 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Deletion of /opt/stack/data/nova/instances/bb6c2f59-c949-4df8-a6e4-ed92d7926639_del complete
Nov 07 04:28:25 user nova-compute[74540]: INFO nova.compute.manager [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Took 0.81 seconds to destroy the instance on the hypervisor.
Nov 07 04:28:25 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:28:25 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:28:26 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:28:26 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Took 0.59 seconds to deallocate network for instance.
Nov 07 04:28:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-c48fd36d-4e70-4d78-b126-31f6a3215aa1 req-8bb7961c-361f-430b-9adc-806ef5583a00 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Received event network-vif-deleted-a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:28:26 user nova-compute[74540]: INFO nova.compute.manager [req-c48fd36d-4e70-4d78-b126-31f6a3215aa1 req-8bb7961c-361f-430b-9adc-806ef5583a00 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Neutron deleted interface a666b729-73b7-4953-871d-fa236a4dd3f0; detaching it from the instance and deleting it from the info cache
Nov 07 04:28:26 user nova-compute[74540]: DEBUG nova.network.neutron [req-c48fd36d-4e70-4d78-b126-31f6a3215aa1 req-8bb7961c-361f-430b-9adc-806ef5583a00 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:28:26 user nova-compute[74540]: DEBUG nova.compute.manager [req-c48fd36d-4e70-4d78-b126-31f6a3215aa1 req-8bb7961c-361f-430b-9adc-806ef5583a00 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Detach interface failed, port_id=a666b729-73b7-4953-871d-fa236a4dd3f0, reason: Instance bb6c2f59-c949-4df8-a6e4-ed92d7926639 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:28:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:28:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:28:26 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:28:26 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:28:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:28:27 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Deleted allocations for instance bb6c2f59-c949-4df8-a6e4-ed92d7926639
Nov 07 04:28:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a8a57d61-4e1d-4527-a32a-8de51a4de6f1 tempest-ServerBootFromVolumeStableRescueTest-1329597446 tempest-ServerBootFromVolumeStableRescueTest-1329597446-project-member] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.062s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:28:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-ecfc0d2b-07ed-4fa1-af91-7f028e35bead req-89a73a1c-8a45-4404-9b32-9f6a29875de8 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Received event network-vif-plugged-a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:28:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ecfc0d2b-07ed-4fa1-af91-7f028e35bead req-89a73a1c-8a45-4404-9b32-9f6a29875de8 service nova] Acquiring lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:28:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ecfc0d2b-07ed-4fa1-af91-7f028e35bead req-89a73a1c-8a45-4404-9b32-9f6a29875de8 service nova] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:28:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ecfc0d2b-07ed-4fa1-af91-7f028e35bead req-89a73a1c-8a45-4404-9b32-9f6a29875de8 service nova] Lock "bb6c2f59-c949-4df8-a6e4-ed92d7926639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:28:27 user nova-compute[74540]: DEBUG nova.compute.manager [req-ecfc0d2b-07ed-4fa1-af91-7f028e35bead req-89a73a1c-8a45-4404-9b32-9f6a29875de8 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] No waiting events found dispatching network-vif-plugged-a666b729-73b7-4953-871d-fa236a4dd3f0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:28:27 user nova-compute[74540]: WARNING nova.compute.manager [req-ecfc0d2b-07ed-4fa1-af91-7f028e35bead req-89a73a1c-8a45-4404-9b32-9f6a29875de8 service nova] [instance: bb6c2f59-c949-4df8-a6e4-ed92d7926639] Received unexpected event network-vif-plugged-a666b729-73b7-4953-871d-fa236a4dd3f0 for instance with vm_state deleted and task_state None.
Nov 07 04:28:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:35 user nova-compute[74540]: DEBUG nova.compute.manager [req-4bcc3e2f-b985-46bb-be16-a4eeace4b2c2 req-7b45ac54-90f7-4c52-be59-51c619c75110 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-changed-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:28:35 user nova-compute[74540]: DEBUG nova.compute.manager [req-4bcc3e2f-b985-46bb-be16-a4eeace4b2c2 req-7b45ac54-90f7-4c52-be59-51c619c75110 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Refreshing instance network info cache due to event network-changed-7e6e59a5-614a-4fe8-ab91-bdf847c4209e. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:28:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4bcc3e2f-b985-46bb-be16-a4eeace4b2c2 req-7b45ac54-90f7-4c52-be59-51c619c75110 service nova] Acquiring lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:28:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4bcc3e2f-b985-46bb-be16-a4eeace4b2c2 req-7b45ac54-90f7-4c52-be59-51c619c75110 service nova] Acquired lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:28:35 user nova-compute[74540]: DEBUG nova.network.neutron [req-4bcc3e2f-b985-46bb-be16-a4eeace4b2c2 req-7b45ac54-90f7-4c52-be59-51c619c75110 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Refreshing network info cache for port 7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:28:35 user nova-compute[74540]: DEBUG nova.network.neutron [req-4bcc3e2f-b985-46bb-be16-a4eeace4b2c2 req-7b45ac54-90f7-4c52-be59-51c619c75110 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updated VIF entry in instance network info cache for port 7e6e59a5-614a-4fe8-ab91-bdf847c4209e. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:28:35 user nova-compute[74540]: DEBUG nova.network.neutron [req-4bcc3e2f-b985-46bb-be16-a4eeace4b2c2 req-7b45ac54-90f7-4c52-be59-51c619c75110 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updating instance_info_cache with network_info: [{"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:28:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4bcc3e2f-b985-46bb-be16-a4eeace4b2c2 req-7b45ac54-90f7-4c52-be59-51c619c75110 service nova] Releasing lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:28:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:28:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "26890199-c159-45e4-9d69-08497f81d5c2" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:28:35 user nova-compute[74540]: INFO nova.compute.manager [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Shelve offloading
Nov 07 04:28:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:36 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Instance destroyed successfully.
Nov 07 04:28:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:28:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:28:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquired lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:28:36 user nova-compute[74540]: DEBUG nova.network.neutron [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.network.neutron [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updating instance_info_cache with network_info: [{"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Releasing lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-357512a5-08a4-479b-aecb-de77b6d36923 req-3333dd16-692e-40fa-9253-a47d89afbdf0 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-vif-unplugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-357512a5-08a4-479b-aecb-de77b6d36923 req-3333dd16-692e-40fa-9253-a47d89afbdf0 service nova] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-357512a5-08a4-479b-aecb-de77b6d36923 req-3333dd16-692e-40fa-9253-a47d89afbdf0 service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-357512a5-08a4-479b-aecb-de77b6d36923 req-3333dd16-692e-40fa-9253-a47d89afbdf0 service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-357512a5-08a4-479b-aecb-de77b6d36923 req-3333dd16-692e-40fa-9253-a47d89afbdf0 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] No waiting events found dispatching network-vif-unplugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:28:37 user nova-compute[74540]: WARNING nova.compute.manager [req-357512a5-08a4-479b-aecb-de77b6d36923 req-3333dd16-692e-40fa-9253-a47d89afbdf0 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received unexpected event network-vif-unplugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e for instance with vm_state active and task_state shelving.
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-357512a5-08a4-479b-aecb-de77b6d36923 req-3333dd16-692e-40fa-9253-a47d89afbdf0 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-357512a5-08a4-479b-aecb-de77b6d36923 req-3333dd16-692e-40fa-9253-a47d89afbdf0 service nova] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-357512a5-08a4-479b-aecb-de77b6d36923 req-3333dd16-692e-40fa-9253-a47d89afbdf0 service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-357512a5-08a4-479b-aecb-de77b6d36923 req-3333dd16-692e-40fa-9253-a47d89afbdf0 service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-357512a5-08a4-479b-aecb-de77b6d36923 req-3333dd16-692e-40fa-9253-a47d89afbdf0 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] No waiting events found dispatching network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:28:37 user nova-compute[74540]: WARNING nova.compute.manager [req-357512a5-08a4-479b-aecb-de77b6d36923 req-3333dd16-692e-40fa-9253-a47d89afbdf0 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received unexpected event network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e for instance with vm_state active and task_state shelving.
Nov 07 04:28:37 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Instance destroyed successfully.
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lazy-loading 'resources' on Instance uuid 26890199-c159-45e4-9d69-08497f81d5c2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-707186112',display_name='tempest-TestShelveInstance-server-707186112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-707186112',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANy3Hf05eA8Uao7ke4zYpDwI2ZJAlLySHnaLwNxrbFZ1mnbZhcv+IFwZq9Hcnhjlrfh/wz5C28+C6yR1LiJlaQPXFaVWzpl1YT74QjHyZN5OUDEqDzeySQfMbDvymXpnw==',key_name='tempest-TestShelveInstance-1395746955',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='973e71d3c5dd4e268defadc32013ea39',ramdisk_id='',reservation_id='r-ulrbyx8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1609380101',owner_user_name='tempest-TestShelveInstance-1609380101-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:27:11Z,user_data=None,user_id='15f998264d6c4ddf89f55894400758cb',uuid=26890199-c159-45e4-9d69-08497f81d5c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Converting VIF {"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_vif [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e6e59a5-61, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bed6a12d-93e9-4690-8481-c233163f6611) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-2f93fbdb-cfbc-4ff0-b890-a0743526cead req-4525981d-a68e-4641-83da-ca8625af98c1 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-changed-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.compute.manager [req-2f93fbdb-cfbc-4ff0-b890-a0743526cead req-4525981d-a68e-4641-83da-ca8625af98c1 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Refreshing instance network info cache due to event network-changed-7e6e59a5-614a-4fe8-ab91-bdf847c4209e. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-2f93fbdb-cfbc-4ff0-b890-a0743526cead req-4525981d-a68e-4641-83da-ca8625af98c1 service nova] Acquiring lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-2f93fbdb-cfbc-4ff0-b890-a0743526cead req-4525981d-a68e-4641-83da-ca8625af98c1 service nova] Acquired lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.network.neutron [req-2f93fbdb-cfbc-4ff0-b890-a0743526cead req-4525981d-a68e-4641-83da-ca8625af98c1 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Refreshing network info cache for port 7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:37 user nova-compute[74540]: INFO os_vif [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61')
Nov 07 04:28:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdxcXUkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:28:37 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5c7b9c-62e5-45c5-8e7c-24ceeb19c40c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:28:37 user nova-compute[74540]: No targets found.
Nov 07 04:28:37 user nova-compute[74540]: iSNS:
Nov 07 04:28:37 user nova-compute[74540]: No targets found.
Nov 07 04:28:37 user nova-compute[74540]: STATIC:
Nov 07 04:28:37 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a
Nov 07 04:28:37 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:28:37 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:28:37 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7
Nov 07 04:28:37 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:28:37 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:28:37 user nova-compute[74540]: FIRMWARE:
Nov 07 04:28:37 user nova-compute[74540]: No targets found.
Nov 07 04:28:37 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:28:37 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:28:37 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[45307bb1-d983-436d-a4e0-e6d4080a0911]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[715a18f5-d61e-492e-81c4-73fa0e1130e8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:28:37 user nova-compute[74540]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:28:37 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:28:37 user nova-compute[74540]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:28:37 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc23bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a'): ({'sdd'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Removing single pathed devices sdd {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1303ef1e-9e94-424e-beab-6b260c8bba25]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aca4e20-bcd3-43d2-ba02-1b6fdb9a986b]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Flushing IO for device /dev/sdd {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6573aaff-e3b3-41b4-b26c-6674019bc656]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a2139d-c03f-4d27-931d-fbee4834c1b5]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] SCSI volumes sdd have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c354cb6b-34ea-460e-b8ca-2fdd5bcb7940]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:28:37 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[41abfb4b-5216-4adb-8e8f-22fca70e127e]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:28:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260]
Nov 07 04:28:38 user nova-compute[74540]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260] successful.
Nov 07 04:28:38 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:28:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:28:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:28:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9423867d-86f3-4e80-b9e2-28789514fec7]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:28:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:28:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:28:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] <== disconnect_volume: return (311ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:28:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:28:38 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Deleting instance files /opt/stack/data/nova/instances/26890199-c159-45e4-9d69-08497f81d5c2_del
Nov 07 04:28:38 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Deletion of /opt/stack/data/nova/instances/26890199-c159-45e4-9d69-08497f81d5c2_del complete
Nov 07 04:28:38 user nova-compute[74540]: DEBUG nova.network.neutron [req-2f93fbdb-cfbc-4ff0-b890-a0743526cead req-4525981d-a68e-4641-83da-ca8625af98c1 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updated VIF entry in instance network info cache for port 7e6e59a5-614a-4fe8-ab91-bdf847c4209e. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:28:38 user nova-compute[74540]: DEBUG nova.network.neutron [req-2f93fbdb-cfbc-4ff0-b890-a0743526cead req-4525981d-a68e-4641-83da-ca8625af98c1 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updating instance_info_cache with network_info: [{"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": null, "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:28:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-2f93fbdb-cfbc-4ff0-b890-a0743526cead req-4525981d-a68e-4641-83da-ca8625af98c1 service nova] Releasing lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:28:39 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Deleted allocations for instance 26890199-c159-45e4-9d69-08497f81d5c2
Nov 07 04:28:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:28:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:28:39 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lazy-loading 'numa_topology' on Instance uuid 26890199-c159-45e4-9d69-08497f81d5c2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:28:39 user nova-compute[74540]: DEBUG nova.objects.base [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Object Instance<26890199-c159-45e4-9d69-08497f81d5c2> lazy-loaded attributes: resources,numa_topology {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:28:39 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:28:39 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:28:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:28:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d81df237-ea24-460d-a9ed-7c2062008062 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "26890199-c159-45e4-9d69-08497f81d5c2" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.466s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:28:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:28:50 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:28:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:53 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:28:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:28:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:28:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:28:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:28:57 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:28:59 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:29:01 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:29:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:29:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:29:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:29:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:29:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:29:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:29:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:29:02 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:29:02 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:29:02 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:29:03 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:29:03 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:29:03 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=24.85134506225586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 7ea40dee-8c35-4508-a8c1-34772281aa15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:29:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:29:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:06 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:29:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:29:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 04:29:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "5d79fc2a-182b-47f5-bec1-5505591f4539" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:29:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:29:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:29:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:29:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:29:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:29:16 user nova-compute[74540]: INFO nova.compute.claims [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Claim successful on node user
Nov 07 04:29:16 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:29:16 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:29:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:29:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG nova.network.neutron [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:29:17 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:29:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG nova.policy [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f3aed6c53894c1b81bcbf75a78f164f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '120c7af771a74fbea86b645109eb9c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:29:17 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Creating image(s)
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "/opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "/opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.208s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.201s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk 1073741824" returned: 0 in 0.058s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.200s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:29:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Successfully created port: 7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Cannot resize image /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Ensure instance console log exists: /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-0c6a6fb6-ad9c-491a-aa0a-d3647f9c0ffc req-c7d69ab5-f945-49be-96de-f4aec4689f30 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-changed-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-0c6a6fb6-ad9c-491a-aa0a-d3647f9c0ffc req-c7d69ab5-f945-49be-96de-f4aec4689f30 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Refreshing instance network info cache due to event network-changed-356a2bea-a767-4948-b7f5-3f1871db48f0. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0c6a6fb6-ad9c-491a-aa0a-d3647f9c0ffc req-c7d69ab5-f945-49be-96de-f4aec4689f30 service nova] Acquiring lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0c6a6fb6-ad9c-491a-aa0a-d3647f9c0ffc req-c7d69ab5-f945-49be-96de-f4aec4689f30 service nova] Acquired lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-0c6a6fb6-ad9c-491a-aa0a-d3647f9c0ffc req-c7d69ab5-f945-49be-96de-f4aec4689f30 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Refreshing network info cache for port 356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Successfully updated port: 7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquired lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-054d63c3-b7ca-4328-bea5-8e79983137ed req-8b8b1199-4edb-4e6b-9248-af8e2a39bab3 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Received event network-changed-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-054d63c3-b7ca-4328-bea5-8e79983137ed req-8b8b1199-4edb-4e6b-9248-af8e2a39bab3 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Refreshing instance network info cache due to event network-changed-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-054d63c3-b7ca-4328-bea5-8e79983137ed req-8b8b1199-4edb-4e6b-9248-af8e2a39bab3 service nova] Acquiring lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-0c6a6fb6-ad9c-491a-aa0a-d3647f9c0ffc req-c7d69ab5-f945-49be-96de-f4aec4689f30 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updated VIF entry in instance network info cache for port 356a2bea-a767-4948-b7f5-3f1871db48f0. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-0c6a6fb6-ad9c-491a-aa0a-d3647f9c0ffc req-c7d69ab5-f945-49be-96de-f4aec4689f30 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updating instance_info_cache with network_info: [{"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:29:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0c6a6fb6-ad9c-491a-aa0a-d3647f9c0ffc req-c7d69ab5-f945-49be-96de-f4aec4689f30 service nova] Releasing lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.network.neutron [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Updating instance_info_cache with network_info: [{"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Releasing lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Instance network_info: |[{"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-054d63c3-b7ca-4328-bea5-8e79983137ed req-8b8b1199-4edb-4e6b-9248-af8e2a39bab3 service nova] Acquired lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-054d63c3-b7ca-4328-bea5-8e79983137ed req-8b8b1199-4edb-4e6b-9248-af8e2a39bab3 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Refreshing network info cache for port 7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Start _get_guest_xml network_info=[{"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:29:19 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:29:19 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-735742575',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-735742575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7357425',id=44,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPZAnwWkRUtPreBpye4Fg6smQbY+PkOG02vqNvOICpAxkDEMgc1t1wzB4jYTYX5Ad6jxjRVfLVj4HdCK5LjFc32HGYpOLwM3Cxci5nBf5SNSvsj3FGdYDvlODAXfrRD1A==',key_name='tempest-keypair-1959887095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120c7af771a74fbea86b645109eb9c39',ramdisk_id='',reservation_id='r-ih5wdbu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-515724616',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:29:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f3aed6c53894c1b81bcbf75a78f164f',uuid=5d79fc2a-182b-47f5-bec1-5505591f4539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Converting VIF {"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1f:7e,bridge_name='br-int',has_traffic_filtering=True,id=7ae3793c-0cb0-4ff6-a159-2509d44bc8b6,network=Network(e48116ca-35ca-4daa-a480-c8ca1c426b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae3793c-0c') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.objects.instance [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d79fc2a-182b-47f5-bec1-5505591f4539 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:29:19 user nova-compute[74540]:   <uuid>5d79fc2a-182b-47f5-bec1-5505591f4539</uuid>
Nov 07 04:29:19 user nova-compute[74540]:   <name>instance-0000002c</name>
Nov 07 04:29:19 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:29:19 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:29:19 user nova-compute[74540]:   <metadata>
Nov 07 04:29:19 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:29:19 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:29:19 user nova-compute[74540]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-735742575</nova:name>
Nov 07 04:29:19 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:29:19</nova:creationTime>
Nov 07 04:29:19 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:29:19 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:29:19 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:29:19 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:29:19 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:29:19 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:29:19 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:29:19 user nova-compute[74540]:       <nova:owner>
Nov 07 04:29:19 user nova-compute[74540]:         <nova:user uuid="8f3aed6c53894c1b81bcbf75a78f164f">tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member</nova:user>
Nov 07 04:29:19 user nova-compute[74540]:         <nova:project uuid="120c7af771a74fbea86b645109eb9c39">tempest-TestServerVolumeAttachScenarioOldVersion-515724616</nova:project>
Nov 07 04:29:19 user nova-compute[74540]:       </nova:owner>
Nov 07 04:29:19 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:29:19 user nova-compute[74540]:       <nova:ports>
Nov 07 04:29:19 user nova-compute[74540]:         <nova:port uuid="7ae3793c-0cb0-4ff6-a159-2509d44bc8b6">
Nov 07 04:29:19 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 04:29:19 user nova-compute[74540]:         </nova:port>
Nov 07 04:29:19 user nova-compute[74540]:       </nova:ports>
Nov 07 04:29:19 user nova-compute[74540]:     </nova:instance>
Nov 07 04:29:19 user nova-compute[74540]:   </metadata>
Nov 07 04:29:19 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:29:19 user nova-compute[74540]:     <system>
Nov 07 04:29:19 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:29:19 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:29:19 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:29:19 user nova-compute[74540]:       <entry name="serial">5d79fc2a-182b-47f5-bec1-5505591f4539</entry>
Nov 07 04:29:19 user nova-compute[74540]:       <entry name="uuid">5d79fc2a-182b-47f5-bec1-5505591f4539</entry>
Nov 07 04:29:19 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:29:19 user nova-compute[74540]:     </system>
Nov 07 04:29:19 user nova-compute[74540]:   </sysinfo>
Nov 07 04:29:19 user nova-compute[74540]:   <os>
Nov 07 04:29:19 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:29:19 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:29:19 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:29:19 user nova-compute[74540]:   </os>
Nov 07 04:29:19 user nova-compute[74540]:   <features>
Nov 07 04:29:19 user nova-compute[74540]:     <acpi/>
Nov 07 04:29:19 user nova-compute[74540]:     <apic/>
Nov 07 04:29:19 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:29:19 user nova-compute[74540]:   </features>
Nov 07 04:29:19 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:29:19 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:29:19 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:29:19 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:29:19 user nova-compute[74540]:   </clock>
Nov 07 04:29:19 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:29:19 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:29:19 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:29:19 user nova-compute[74540]:   </cpu>
Nov 07 04:29:19 user nova-compute[74540]:   <devices>
Nov 07 04:29:19 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:29:19 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:29:19 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk"/>
Nov 07 04:29:19 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:29:19 user nova-compute[74540]:     </disk>
Nov 07 04:29:19 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:29:19 user nova-compute[74540]:       <mac address="fa:16:3e:f7:1f:7e"/>
Nov 07 04:29:19 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:29:19 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:29:19 user nova-compute[74540]:       <target dev="tap7ae3793c-0c"/>
Nov 07 04:29:19 user nova-compute[74540]:     </interface>
Nov 07 04:29:19 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:29:19 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/console.log" append="off"/>
Nov 07 04:29:19 user nova-compute[74540]:     </serial>
Nov 07 04:29:19 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:29:19 user nova-compute[74540]:     <video>
Nov 07 04:29:19 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:29:19 user nova-compute[74540]:     </video>
Nov 07 04:29:19 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:29:19 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:29:19 user nova-compute[74540]:     </rng>
Nov 07 04:29:19 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:29:19 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:29:19 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:29:19 user nova-compute[74540]:     </memballoon>
Nov 07 04:29:19 user nova-compute[74540]:   </devices>
Nov 07 04:29:19 user nova-compute[74540]: </domain>
Nov 07 04:29:19 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-735742575',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-735742575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7357425',id=44,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPZAnwWkRUtPreBpye4Fg6smQbY+PkOG02vqNvOICpAxkDEMgc1t1wzB4jYTYX5Ad6jxjRVfLVj4HdCK5LjFc32HGYpOLwM3Cxci5nBf5SNSvsj3FGdYDvlODAXfrRD1A==',key_name='tempest-keypair-1959887095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='120c7af771a74fbea86b645109eb9c39',ramdisk_id='',reservation_id='r-ih5wdbu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-515724616',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:29:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f3aed6c53894c1b81bcbf75a78f164f',uuid=5d79fc2a-182b-47f5-bec1-5505591f4539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Converting VIF {"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1f:7e,bridge_name='br-int',has_traffic_filtering=True,id=7ae3793c-0cb0-4ff6-a159-2509d44bc8b6,network=Network(e48116ca-35ca-4daa-a480-c8ca1c426b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae3793c-0c') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG os_vif [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1f:7e,bridge_name='br-int',has_traffic_filtering=True,id=7ae3793c-0cb0-4ff6-a159-2509d44bc8b6,network=Network(e48116ca-35ca-4daa-a480-c8ca1c426b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae3793c-0c') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10e3128c-8320-55b4-bfee-22138aca8520', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ae3793c-0c, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ae3793c-0c, col_values=(('qos', UUID('dc55b503-5345-402d-a26a-d956c9dbd670')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ae3793c-0c, col_values=(('external_ids', {'iface-id': '7ae3793c-0cb0-4ff6-a159-2509d44bc8b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:1f:7e', 'vm-uuid': '5d79fc2a-182b-47f5-bec1-5505591f4539'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:19 user nova-compute[74540]: INFO os_vif [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:1f:7e,bridge_name='br-int',has_traffic_filtering=True,id=7ae3793c-0cb0-4ff6-a159-2509d44bc8b6,network=Network(e48116ca-35ca-4daa-a480-c8ca1c426b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae3793c-0c')
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] No VIF found with MAC fa:16:3e:f7:1f:7e, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:29:19 user nova-compute[74540]: INFO nova.compute.manager [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Detaching volume b3cb1bfa-ea57-4213-b444-65ee81deebf7
Nov 07 04:29:19 user nova-compute[74540]: INFO nova.virt.block_device [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Attempting to driver detach volume b3cb1bfa-ea57-4213-b444-65ee81deebf7 from mountpoint /dev/vdb
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Attempting to detach device vdb from instance 7ea40dee-8c35-4508-a8c1-34772281aa15 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:29:19 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:29:19 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:29:19 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:29:19 user nova-compute[74540]:   <serial>b3cb1bfa-ea57-4213-b444-65ee81deebf7</serial>
Nov 07 04:29:19 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 04:29:19 user nova-compute[74540]: </disk>
Nov 07 04:29:19 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:29:19 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Successfully detached device vdb from instance 7ea40dee-8c35-4508-a8c1-34772281aa15 from the persistent domain config.
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7ea40dee-8c35-4508-a8c1-34772281aa15 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:29:19 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:29:19 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:29:19 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:29:19 user nova-compute[74540]:   <serial>b3cb1bfa-ea57-4213-b444-65ee81deebf7</serial>
Nov 07 04:29:19 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 07 04:29:19 user nova-compute[74540]: </disk>
Nov 07 04:29:19 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-054d63c3-b7ca-4328-bea5-8e79983137ed req-8b8b1199-4edb-4e6b-9248-af8e2a39bab3 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Updated VIF entry in instance network info cache for port 7ae3793c-0cb0-4ff6-a159-2509d44bc8b6. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-054d63c3-b7ca-4328-bea5-8e79983137ed req-8b8b1199-4edb-4e6b-9248-af8e2a39bab3 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Updating instance_info_cache with network_info: [{"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-054d63c3-b7ca-4328-bea5-8e79983137ed req-8b8b1199-4edb-4e6b-9248-af8e2a39bab3 service nova] Releasing lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:29:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:20 user nova-compute[74540]: DEBUG nova.compute.manager [req-d07bfbad-0e3d-4977-bf4f-c3378c732089 req-8fde16ff-b6f9-4176-894c-7f0cbc656999 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-changed-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:29:20 user nova-compute[74540]: DEBUG nova.compute.manager [req-d07bfbad-0e3d-4977-bf4f-c3378c732089 req-8fde16ff-b6f9-4176-894c-7f0cbc656999 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Refreshing instance network info cache due to event network-changed-356a2bea-a767-4948-b7f5-3f1871db48f0. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:29:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d07bfbad-0e3d-4977-bf4f-c3378c732089 req-8fde16ff-b6f9-4176-894c-7f0cbc656999 service nova] Acquiring lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:29:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d07bfbad-0e3d-4977-bf4f-c3378c732089 req-8fde16ff-b6f9-4176-894c-7f0cbc656999 service nova] Acquired lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:29:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-d07bfbad-0e3d-4977-bf4f-c3378c732089 req-8fde16ff-b6f9-4176-894c-7f0cbc656999 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Refreshing network info cache for port 356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:29:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7ea40dee-8c35-4508-a8c1-34772281aa15 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:29:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-d07bfbad-0e3d-4977-bf4f-c3378c732089 req-8fde16ff-b6f9-4176-894c-7f0cbc656999 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updated VIF entry in instance network info cache for port 356a2bea-a767-4948-b7f5-3f1871db48f0. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:29:20 user nova-compute[74540]: DEBUG nova.network.neutron [req-d07bfbad-0e3d-4977-bf4f-c3378c732089 req-8fde16ff-b6f9-4176-894c-7f0cbc656999 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updating instance_info_cache with network_info: [{"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:29:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-d07bfbad-0e3d-4977-bf4f-c3378c732089 req-8fde16ff-b6f9-4176-894c-7f0cbc656999 service nova] Releasing lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:29:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-bf6a438f-25dd-4adc-aec7-6f774126d7bf req-f661dfe2-160f-47d4-a43a-9efb0a391b39 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Received event network-vif-plugged-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:29:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bf6a438f-25dd-4adc-aec7-6f774126d7bf req-f661dfe2-160f-47d4-a43a-9efb0a391b39 service nova] Acquiring lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:29:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bf6a438f-25dd-4adc-aec7-6f774126d7bf req-f661dfe2-160f-47d4-a43a-9efb0a391b39 service nova] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:29:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bf6a438f-25dd-4adc-aec7-6f774126d7bf req-f661dfe2-160f-47d4-a43a-9efb0a391b39 service nova] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:29:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-bf6a438f-25dd-4adc-aec7-6f774126d7bf req-f661dfe2-160f-47d4-a43a-9efb0a391b39 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] No waiting events found dispatching network-vif-plugged-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:29:21 user nova-compute[74540]: WARNING nova.compute.manager [req-bf6a438f-25dd-4adc-aec7-6f774126d7bf req-f661dfe2-160f-47d4-a43a-9efb0a391b39 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Received unexpected event network-vif-plugged-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 for instance with vm_state building and task_state spawning.
Nov 07 04:29:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:29:23 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Instance spawned successfully.
Nov 07 04:29:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:29:23 user nova-compute[74540]: INFO nova.compute.manager [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 07 04:29:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-1ae79eef-92e7-4456-ba24-cddea768ee41 req-eedf81ee-96db-4b3f-9a03-702959e32fcc service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Received event network-vif-plugged-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1ae79eef-92e7-4456-ba24-cddea768ee41 req-eedf81ee-96db-4b3f-9a03-702959e32fcc service nova] Acquiring lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1ae79eef-92e7-4456-ba24-cddea768ee41 req-eedf81ee-96db-4b3f-9a03-702959e32fcc service nova] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1ae79eef-92e7-4456-ba24-cddea768ee41 req-eedf81ee-96db-4b3f-9a03-702959e32fcc service nova] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:29:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-1ae79eef-92e7-4456-ba24-cddea768ee41 req-eedf81ee-96db-4b3f-9a03-702959e32fcc service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] No waiting events found dispatching network-vif-plugged-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:29:23 user nova-compute[74540]: WARNING nova.compute.manager [req-1ae79eef-92e7-4456-ba24-cddea768ee41 req-eedf81ee-96db-4b3f-9a03-702959e32fcc service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Received unexpected event network-vif-plugged-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 for instance with vm_state building and task_state spawning.
Nov 07 04:29:23 user nova-compute[74540]: INFO nova.compute.manager [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Took 6.96 seconds to build instance.
Nov 07 04:29:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-9d500bba-aaa7-4b05-a579-8ad68d7e3ea6 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.087s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:29:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:29:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:40 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7ea40dee-8c35-4508-a8c1-34772281aa15 is timed out.
Nov 07 04:29:40 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Successfully detached device vdb from instance 7ea40dee-8c35-4508-a8c1-34772281aa15 from the live domain config.
Nov 07 04:29:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUDCLiag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:29:40 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd4ed90-548b-4cf8-bb07-a308df74e2a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:29:40 user nova-compute[74540]: No targets found.
Nov 07 04:29:40 user nova-compute[74540]: iSNS:
Nov 07 04:29:40 user nova-compute[74540]: No targets found.
Nov 07 04:29:40 user nova-compute[74540]: STATIC:
Nov 07 04:29:40 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7
Nov 07 04:29:40 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:29:40 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:29:40 user nova-compute[74540]: FIRMWARE:
Nov 07 04:29:40 user nova-compute[74540]: No targets found.
Nov 07 04:29:40 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:29:40 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:29:40 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20a3575-f7fd-46d5-9941-bc913839e0c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18262b6-9e99-4504-89f5-6e0a2a20b19f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:29:40 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 (non-flash)
Nov 07 04:29:40 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc109cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[af27bdf8-016a-488b-a739-f7a38672fe49]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[664641e9-d932-4cbd-beb7-a3ad661ac7ff]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbf4d2c-626f-4ff1-b6ed-753b2a733218]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdad470-0ef3-4101-8a2e-429f5d3adec0]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[984854f2-49c4-461b-aa56-0fc21cf4fc18]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3be2ad-ad56-4b05-b3fd-6084ba47ae3e]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260]
Nov 07 04:29:40 user nova-compute[74540]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7, portal: 172.16.0.220,3260] successful.
Nov 07 04:29:40 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b3cb1bfa-ea57-4213-b444-65ee81deebf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[088739af-ded5-4a37-b7e2-b31dbd1f0535]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] <== disconnect_volume: return (315ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:29:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:29:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:41 user nova-compute[74540]: DEBUG nova.objects.instance [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'flavor' on Instance uuid 7ea40dee-8c35-4508-a8c1-34772281aa15 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:29:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-43b1a5db-0cd4-4371-8bec-beaffb351bf4 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.487s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:29:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:51 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:29:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:29:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:29:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:29:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:29:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:29:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:29:59 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:30:01 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:30:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:30:03 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:30:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:30:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:30:03 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:30:03 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:30:03 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:30:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:05 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:30:05 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:30:05 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=24.81142807006836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:30:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:30:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:30:05 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 7ea40dee-8c35-4508-a8c1-34772281aa15 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:30:05 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d79fc2a-182b-47f5-bec1-5505591f4539 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:30:05 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:30:05 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:30:05 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:30:05 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:30:05 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:30:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:30:08 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:30:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:30:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:30:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:30:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:30:08 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:30:08 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 7ea40dee-8c35-4508-a8c1-34772281aa15 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:30:09 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updating instance_info_cache with network_info: [{"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:30:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-7ea40dee-8c35-4508-a8c1-34772281aa15" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:30:09 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:30:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:30:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:30:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:30:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:30:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:30:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:30:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:30:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:30:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:30:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:30:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:30:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:30:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:30:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:30:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:30:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:30:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:30:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:30:20 user nova-compute[74540]: INFO nova.compute.manager [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Terminating instance
Nov 07 04:30:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:30:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-69ad2f45-337f-4895-a821-960a4267f22a req-a67899eb-4bb4-4386-a155-a63a24a2f795 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-vif-unplugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-69ad2f45-337f-4895-a821-960a4267f22a req-a67899eb-4bb4-4386-a155-a63a24a2f795 service nova] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-69ad2f45-337f-4895-a821-960a4267f22a req-a67899eb-4bb4-4386-a155-a63a24a2f795 service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-69ad2f45-337f-4895-a821-960a4267f22a req-a67899eb-4bb4-4386-a155-a63a24a2f795 service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-69ad2f45-337f-4895-a821-960a4267f22a req-a67899eb-4bb4-4386-a155-a63a24a2f795 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] No waiting events found dispatching network-vif-unplugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-69ad2f45-337f-4895-a821-960a4267f22a req-a67899eb-4bb4-4386-a155-a63a24a2f795 service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-vif-unplugged-356a2bea-a767-4948-b7f5-3f1871db48f0 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:30:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Instance destroyed successfully.
Nov 07 04:30:21 user nova-compute[74540]: DEBUG nova.objects.instance [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'resources' on Instance uuid 7ea40dee-8c35-4508-a8c1-34772281aa15 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1823291217',display_name='tempest-TestMinimumBasicScenario-server-1823291217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1823291217',id=41,image_ref='b4dd7e24-5719-46fc-be3b-c2b15e7a318a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZ5g6Rw23CRhXshdRlt3kBkQr87DRjsdcdtrFVqa3XSLXtWNb0bH/ZdAzkAy0kffcjbYZ+/V+DIhpBa4kXn4wMwWewFeUAaDJqnWuMnJb2JgVCLnX36JI+9j7zR3ryXcw==',key_name='tempest-TestMinimumBasicScenario-872081033',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:24:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92bc5f60b66347ca8404e1553ec719d7',ramdisk_id='',reservation_id='r-rw8uyp2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b4dd7e24-5719-46fc-be3b-c2b15e7a318a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-702707071',owner_user_name='tempest-TestMinimumBasicScenario-702707071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:27:34Z,user_data=None,user_id='48997d7730cb406dbf7d127224a52543',uuid=7ea40dee-8c35-4508-a8c1-34772281aa15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converting VIF {"id": "356a2bea-a767-4948-b7f5-3f1871db48f0", "address": "fa:16:3e:52:b2:6e", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap356a2bea-a7", "ovs_interfaceid": "356a2bea-a767-4948-b7f5-3f1871db48f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG os_vif [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap356a2bea-a7, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2494efd5-743c-4e05-aea7-3c70de1698da) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:30:21 user nova-compute[74540]: INFO os_vif [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:b2:6e,bridge_name='br-int',has_traffic_filtering=True,id=356a2bea-a767-4948-b7f5-3f1871db48f0,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap356a2bea-a7')
Nov 07 04:30:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Deleting instance files /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15_del
Nov 07 04:30:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Deletion of /opt/stack/data/nova/instances/7ea40dee-8c35-4508-a8c1-34772281aa15_del complete
Nov 07 04:30:21 user nova-compute[74540]: INFO nova.compute.manager [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 07 04:30:21 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:30:21 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:30:21 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Took 0.49 seconds to deallocate network for instance.
Nov 07 04:30:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-25d256a1-4554-45cf-9666-f3bc77bfa37a req-0681c64d-086c-4b88-9167-ad24f020b92d service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-vif-deleted-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:30:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:30:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:30:22 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:30:22 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:30:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:30:22 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Deleted allocations for instance 7ea40dee-8c35-4508-a8c1-34772281aa15
Nov 07 04:30:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-0be0b74d-3676-42dc-9404-6989ef3520b9 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.787s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:30:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-3bca163b-36cd-4e08-8c7e-f2cb2b1343f2 req-5dc99c03-60a6-4a6d-b7c7-2a638588b36a service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received event network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:30:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3bca163b-36cd-4e08-8c7e-f2cb2b1343f2 req-5dc99c03-60a6-4a6d-b7c7-2a638588b36a service nova] Acquiring lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:30:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3bca163b-36cd-4e08-8c7e-f2cb2b1343f2 req-5dc99c03-60a6-4a6d-b7c7-2a638588b36a service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:30:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3bca163b-36cd-4e08-8c7e-f2cb2b1343f2 req-5dc99c03-60a6-4a6d-b7c7-2a638588b36a service nova] Lock "7ea40dee-8c35-4508-a8c1-34772281aa15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:30:23 user nova-compute[74540]: DEBUG nova.compute.manager [req-3bca163b-36cd-4e08-8c7e-f2cb2b1343f2 req-5dc99c03-60a6-4a6d-b7c7-2a638588b36a service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] No waiting events found dispatching network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:30:23 user nova-compute[74540]: WARNING nova.compute.manager [req-3bca163b-36cd-4e08-8c7e-f2cb2b1343f2 req-5dc99c03-60a6-4a6d-b7c7-2a638588b36a service nova] [instance: 7ea40dee-8c35-4508-a8c1-34772281aa15] Received unexpected event network-vif-plugged-356a2bea-a767-4948-b7f5-3f1871db48f0 for instance with vm_state deleted and task_state None.
Nov 07 04:30:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "26890199-c159-45e4-9d69-08497f81d5c2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:30:28 user nova-compute[74540]: INFO nova.compute.manager [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Unshelving
Nov 07 04:30:28 user nova-compute[74540]: INFO nova.virt.block_device [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Booting with volume 7719ba97-3b4a-43e1-96b0-ce5fca24be6a at /dev/vda
Nov 07 04:30:28 user nova-compute[74540]: DEBUG os_brick.utils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b14265-52e0-406d-ad48-027899666fcd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd761d3c-82f9-4aa0-98bd-36579067f61c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9930e393-715d-404c-8fd7-facf29cc4208]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[618b766d-03f6-4482-a30a-9c2c1779c4a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:30:28 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:30:28 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d344dc0-5e0b-44f2-bc19-3e959a4bb320]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG os_brick.utils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:30:28 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updating existing volume attachment record: b592887a-47f8-442d-b76b-feaab44b2ade {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:30:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:30:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:30:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:30:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:30:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:30:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:30:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:30:49 user nova-compute[74540]: DEBUG nova.objects.instance [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lazy-loading 'pci_requests' on Instance uuid 26890199-c159-45e4-9d69-08497f81d5c2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:30:49 user nova-compute[74540]: DEBUG nova.objects.instance [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lazy-loading 'numa_topology' on Instance uuid 26890199-c159-45e4-9d69-08497f81d5c2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:30:49 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:30:49 user nova-compute[74540]: INFO nova.compute.claims [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Claim successful on node user
Nov 07 04:30:49 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:30:49 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:30:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:30:49 user nova-compute[74540]: INFO nova.network.neutron [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updating port 7e6e59a5-614a-4fe8-ab91-bdf847c4209e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 07 04:30:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:30:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquired lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:30:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:30:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-05928548-fb7d-4bde-aefd-f92761d6f224 req-93e61cc0-22a0-4211-854f-780a4ad9cfba service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-changed-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:30:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-05928548-fb7d-4bde-aefd-f92761d6f224 req-93e61cc0-22a0-4211-854f-780a4ad9cfba service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Refreshing instance network info cache due to event network-changed-7e6e59a5-614a-4fe8-ab91-bdf847c4209e. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:30:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-05928548-fb7d-4bde-aefd-f92761d6f224 req-93e61cc0-22a0-4211-854f-780a4ad9cfba service nova] Acquiring lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:30:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updating instance_info_cache with network_info: [{"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Releasing lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:30:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Creating image(s)
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Ensure instance console log exists: /opt/stack/data/nova/instances/26890199-c159-45e4-9d69-08497f81d5c2/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Start _get_guest_xml network_info=[{"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdxcXUkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26890199-c159-45e4-9d69-08497f81d5c2', 'attached_at': '', 'detached_at': '', 'volume_id': '7719ba97-3b4a-43e1-96b0-ce5fca24be6a', 'serial': '7719ba97-3b4a-43e1-96b0-ce5fca24be6a'}, 'boot_index': 0, 'attachment_id': 'b592887a-47f8-442d-b76b-feaab44b2ade', 'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-05928548-fb7d-4bde-aefd-f92761d6f224 req-93e61cc0-22a0-4211-854f-780a4ad9cfba service nova] Acquired lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.network.neutron [req-05928548-fb7d-4bde-aefd-f92761d6f224 req-93e61cc0-22a0-4211-854f-780a4ad9cfba service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Refreshing network info cache for port 7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:30:51 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:30:51 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.objects.instance [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lazy-loading 'vcpu_model' on Instance uuid 26890199-c159-45e4-9d69-08497f81d5c2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.objects.base [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Object Instance<26890199-c159-45e4-9d69-08497f81d5c2> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdxcXUkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:30:51 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:30:51 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:30:51 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1b1174-4dc1-4548-b08b-69cdb9c6f032]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:30:51 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a43e9f-8206-4790-be90-2ddbacadf7fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a] added
Nov 07 04:30:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3849173-6a95-499c-ad18-f7f2559a0f2c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c0ad39-6e30-48c8-8089-5aeb9cdb2e6a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdxcXUkS {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdxcXUkS" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae81a67-dcaf-48c4-aa4e-58f74feea529]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CdxcXUkS'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb98829d-8e73-4f3b-9a76-37264dd2e104]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58e4e05-88f1-44e5-861f-ed064830e432]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:30:51 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:30:51 user nova-compute[74540]:  {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:30:51 user nova-compute[74540]: WARNING os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 04:30:51 user nova-compute[74540]: 
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d46ed2-c8e1-45a3-b4ba-6fad0261f71e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260]
Nov 07 04:30:51 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260] successful.
Nov 07 04:30:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dade0e-f966-4630-9855-59e3a3f4994e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc8f0ee-aa09-4490-b956-2ff3f622acf7]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:30:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:30:51 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bee60ac-6fd0-4c58-984c-ce3f13827c55]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdxcXUkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.network.neutron [req-05928548-fb7d-4bde-aefd-f92761d6f224 req-93e61cc0-22a0-4211-854f-780a4ad9cfba service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updated VIF entry in instance network info cache for port 7e6e59a5-614a-4fe8-ab91-bdf847c4209e. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG nova.network.neutron [req-05928548-fb7d-4bde-aefd-f92761d6f224 req-93e61cc0-22a0-4211-854f-780a4ad9cfba service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updating instance_info_cache with network_info: [{"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:30:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-05928548-fb7d-4bde-aefd-f92761d6f224 req-93e61cc0-22a0-4211-854f-780a4ad9cfba service nova] Releasing lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23237383734303766', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237383734303766', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T04:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-707186112',display_name='tempest-TestShelveInstance-server-707186112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-707186112',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1395746955',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='973e71d3c5dd4e268defadc32013ea39',ramdisk_id='',reservation_id='r-ulrbyx8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1609380101',owner_user_name='tempest-TestShelveInstance-1609380101-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:30:28Z,user_data=None,user_id='15f998264d6c4ddf89f55894400758cb',uuid=26890199-c159-45e4-9d69-08497f81d5c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Converting VIF {"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG nova.objects.instance [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lazy-loading 'pci_devices' on Instance uuid 26890199-c159-45e4-9d69-08497f81d5c2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG nova.objects.base [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Object Instance<26890199-c159-45e4-9d69-08497f81d5c2> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74540) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:30:52 user nova-compute[74540]:   <uuid>26890199-c159-45e4-9d69-08497f81d5c2</uuid>
Nov 07 04:30:52 user nova-compute[74540]:   <name>instance-0000002b</name>
Nov 07 04:30:52 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:30:52 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:30:52 user nova-compute[74540]:   <metadata>
Nov 07 04:30:52 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:30:52 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:30:52 user nova-compute[74540]:       <nova:name>tempest-TestShelveInstance-server-707186112</nova:name>
Nov 07 04:30:52 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:30:51</nova:creationTime>
Nov 07 04:30:52 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:30:52 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:30:52 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:30:52 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:30:52 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:30:52 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:30:52 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:30:52 user nova-compute[74540]:       <nova:owner>
Nov 07 04:30:52 user nova-compute[74540]:         <nova:user uuid="15f998264d6c4ddf89f55894400758cb">tempest-TestShelveInstance-1609380101-project-member</nova:user>
Nov 07 04:30:52 user nova-compute[74540]:         <nova:project uuid="973e71d3c5dd4e268defadc32013ea39">tempest-TestShelveInstance-1609380101</nova:project>
Nov 07 04:30:52 user nova-compute[74540]:       </nova:owner>
Nov 07 04:30:52 user nova-compute[74540]:       <nova:ports>
Nov 07 04:30:52 user nova-compute[74540]:         <nova:port uuid="7e6e59a5-614a-4fe8-ab91-bdf847c4209e">
Nov 07 04:30:52 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 04:30:52 user nova-compute[74540]:         </nova:port>
Nov 07 04:30:52 user nova-compute[74540]:       </nova:ports>
Nov 07 04:30:52 user nova-compute[74540]:     </nova:instance>
Nov 07 04:30:52 user nova-compute[74540]:   </metadata>
Nov 07 04:30:52 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:30:52 user nova-compute[74540]:     <system>
Nov 07 04:30:52 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:30:52 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:30:52 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:30:52 user nova-compute[74540]:       <entry name="serial">26890199-c159-45e4-9d69-08497f81d5c2</entry>
Nov 07 04:30:52 user nova-compute[74540]:       <entry name="uuid">26890199-c159-45e4-9d69-08497f81d5c2</entry>
Nov 07 04:30:52 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:30:52 user nova-compute[74540]:     </system>
Nov 07 04:30:52 user nova-compute[74540]:   </sysinfo>
Nov 07 04:30:52 user nova-compute[74540]:   <os>
Nov 07 04:30:52 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:30:52 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:30:52 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:30:52 user nova-compute[74540]:   </os>
Nov 07 04:30:52 user nova-compute[74540]:   <features>
Nov 07 04:30:52 user nova-compute[74540]:     <acpi/>
Nov 07 04:30:52 user nova-compute[74540]:     <apic/>
Nov 07 04:30:52 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:30:52 user nova-compute[74540]:   </features>
Nov 07 04:30:52 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:30:52 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:30:52 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:30:52 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:30:52 user nova-compute[74540]:   </clock>
Nov 07 04:30:52 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:30:52 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:30:52 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:30:52 user nova-compute[74540]:   </cpu>
Nov 07 04:30:52 user nova-compute[74540]:   <devices>
Nov 07 04:30:52 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:30:52 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:30:52 user nova-compute[74540]:       <source dev="/dev/sdb"/>
Nov 07 04:30:52 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:30:52 user nova-compute[74540]:       <serial>7719ba97-3b4a-43e1-96b0-ce5fca24be6a</serial>
Nov 07 04:30:52 user nova-compute[74540]:     </disk>
Nov 07 04:30:52 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:30:52 user nova-compute[74540]:       <mac address="fa:16:3e:0d:12:8f"/>
Nov 07 04:30:52 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:30:52 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:30:52 user nova-compute[74540]:       <target dev="tap7e6e59a5-61"/>
Nov 07 04:30:52 user nova-compute[74540]:     </interface>
Nov 07 04:30:52 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:30:52 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/26890199-c159-45e4-9d69-08497f81d5c2/console.log" append="off"/>
Nov 07 04:30:52 user nova-compute[74540]:     </serial>
Nov 07 04:30:52 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:30:52 user nova-compute[74540]:     <video>
Nov 07 04:30:52 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:30:52 user nova-compute[74540]:     </video>
Nov 07 04:30:52 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:30:52 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:30:52 user nova-compute[74540]:     </rng>
Nov 07 04:30:52 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:30:52 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:30:52 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:30:52 user nova-compute[74540]:     </memballoon>
Nov 07 04:30:52 user nova-compute[74540]:   </devices>
Nov 07 04:30:52 user nova-compute[74540]: </domain>
Nov 07 04:30:52 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T04:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-707186112',display_name='tempest-TestShelveInstance-server-707186112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-707186112',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1395746955',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:27:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='973e71d3c5dd4e268defadc32013ea39',ramdisk_id='',reservation_id='r-ulrbyx8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1609380101',owner_user_name='tempest-TestShelveInstance-1609380101-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:30:28Z,user_data=None,user_id='15f998264d6c4ddf89f55894400758cb',uuid=26890199-c159-45e4-9d69-08497f81d5c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Converting VIF {"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG os_vif [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6d1bb75-92e1-563d-870a-97a2861d3dae', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e6e59a5-61, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e6e59a5-61, col_values=(('qos', UUID('744ede93-fbdb-4d47-aad5-f643b4f5dbc4')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e6e59a5-61, col_values=(('external_ids', {'iface-id': '7e6e59a5-614a-4fe8-ab91-bdf847c4209e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:12:8f', 'vm-uuid': '26890199-c159-45e4-9d69-08497f81d5c2'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:52 user nova-compute[74540]: INFO os_vif [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61')
Nov 07 04:30:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] No VIF found with MAC fa:16:3e:0d:12:8f, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:30:52 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:30:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-3a5d0be6-703f-4193-82f2-1766d59416f6 req-b0615cbe-d66c-4f04-ac11-faf2f5ae2ecd service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:30:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3a5d0be6-703f-4193-82f2-1766d59416f6 req-b0615cbe-d66c-4f04-ac11-faf2f5ae2ecd service nova] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:30:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3a5d0be6-703f-4193-82f2-1766d59416f6 req-b0615cbe-d66c-4f04-ac11-faf2f5ae2ecd service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:30:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3a5d0be6-703f-4193-82f2-1766d59416f6 req-b0615cbe-d66c-4f04-ac11-faf2f5ae2ecd service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:30:53 user nova-compute[74540]: DEBUG nova.compute.manager [req-3a5d0be6-703f-4193-82f2-1766d59416f6 req-b0615cbe-d66c-4f04-ac11-faf2f5ae2ecd service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] No waiting events found dispatching network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:30:53 user nova-compute[74540]: WARNING nova.compute.manager [req-3a5d0be6-703f-4193-82f2-1766d59416f6 req-b0615cbe-d66c-4f04-ac11-faf2f5ae2ecd service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received unexpected event network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 07 04:30:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:30:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:30:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:30:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:30:55 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Instance spawned successfully.
Nov 07 04:30:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:30:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-af1dbee2-efba-4a64-914f-81e101237238 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "26890199-c159-45e4-9d69-08497f81d5c2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 27.938s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:30:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-7988a159-7be5-4970-8b8d-136f2bd0e388 req-88daa1db-bc9f-4852-84a9-805bdfc66c51 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:30:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7988a159-7be5-4970-8b8d-136f2bd0e388 req-88daa1db-bc9f-4852-84a9-805bdfc66c51 service nova] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:30:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7988a159-7be5-4970-8b8d-136f2bd0e388 req-88daa1db-bc9f-4852-84a9-805bdfc66c51 service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:30:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7988a159-7be5-4970-8b8d-136f2bd0e388 req-88daa1db-bc9f-4852-84a9-805bdfc66c51 service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:30:56 user nova-compute[74540]: DEBUG nova.compute.manager [req-7988a159-7be5-4970-8b8d-136f2bd0e388 req-88daa1db-bc9f-4852-84a9-805bdfc66c51 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] No waiting events found dispatching network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:30:56 user nova-compute[74540]: WARNING nova.compute.manager [req-7988a159-7be5-4970-8b8d-136f2bd0e388 req-88daa1db-bc9f-4852-84a9-805bdfc66c51 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received unexpected event network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e for instance with vm_state active and task_state None.
Nov 07 04:30:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:30:57 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:30:57 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:30:59 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:31:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:03 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:31:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:31:05 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:31:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:05 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:31:05 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:31:05 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:31:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:06 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:31:06 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:31:06 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8692MB free_disk=24.83682632446289GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d79fc2a-182b-47f5-bec1-5505591f4539 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 26890199-c159-45e4-9d69-08497f81d5c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:31:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:31:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:31:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-ab2e2699-76f8-4190-9751-bf375661217c req-6fc4936c-365b-4c2d-86f0-16b366826924 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Received event network-changed-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:31:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-ab2e2699-76f8-4190-9751-bf375661217c req-6fc4936c-365b-4c2d-86f0-16b366826924 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Refreshing instance network info cache due to event network-changed-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:31:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ab2e2699-76f8-4190-9751-bf375661217c req-6fc4936c-365b-4c2d-86f0-16b366826924 service nova] Acquiring lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:31:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ab2e2699-76f8-4190-9751-bf375661217c req-6fc4936c-365b-4c2d-86f0-16b366826924 service nova] Acquired lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:31:07 user nova-compute[74540]: DEBUG nova.network.neutron [req-ab2e2699-76f8-4190-9751-bf375661217c req-6fc4936c-365b-4c2d-86f0-16b366826924 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Refreshing network info cache for port 7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:31:08 user nova-compute[74540]: DEBUG nova.network.neutron [req-ab2e2699-76f8-4190-9751-bf375661217c req-6fc4936c-365b-4c2d-86f0-16b366826924 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Updated VIF entry in instance network info cache for port 7ae3793c-0cb0-4ff6-a159-2509d44bc8b6. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:31:08 user nova-compute[74540]: DEBUG nova.network.neutron [req-ab2e2699-76f8-4190-9751-bf375661217c req-6fc4936c-365b-4c2d-86f0-16b366826924 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Updating instance_info_cache with network_info: [{"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:31:08 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-ab2e2699-76f8-4190-9751-bf375661217c req-6fc4936c-365b-4c2d-86f0-16b366826924 service nova] Releasing lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:31:08 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:31:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:31:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:31:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:31:09 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:31:09 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Updating instance_info_cache with network_info: [{"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:31:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:31:09 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:31:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "5d79fc2a-182b-47f5-bec1-5505591f4539" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:13 user nova-compute[74540]: DEBUG nova.objects.instance [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lazy-loading 'flavor' on Instance uuid 5d79fc2a-182b-47f5-bec1-5505591f4539 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:31:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "5d79fc2a-182b-47f5-bec1-5505591f4539" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:14 user nova-compute[74540]: INFO nova.compute.manager [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Attaching volume 4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 to /dev/vdb
Nov 07 04:31:14 user nova-compute[74540]: DEBUG os_brick.utils [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3461aa-a5b8-4469-8fed-0f4e068ccda6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bd9de6-091c-4509-9067-e944fd129248]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daf4771-7e82-428c-b83b-e411decc4a71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3910866c-05a4-46ad-98a8-30ad472517c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:31:14 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d145792-c236-41c4-8c00-a95e16826d8b]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG os_brick.utils [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Updating existing volume attachment record: 23d99f20-bc56-43fe-af89-2bd83a50e8ad {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:31:14 user nova-compute[74540]: INFO nova.compute.claims [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Claim successful on node user
Nov 07 04:31:14 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG nova.network.neutron [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:31:14 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:31:14 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:31:14 user nova-compute[74540]: DEBUG nova.policy [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48997d7730cb406dbf7d127224a52543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bc5f60b66347ca8404e1553ec719d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:31:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:31:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:31:15 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Creating image(s)
Nov 07 04:31:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "/opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "/opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "/opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:31:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "e64b2c83031ec7165afd435e4ccb897e2c3f0a58" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "e64b2c83031ec7165afd435e4ccb897e2c3f0a58" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58.part --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:15 user nova-compute[74540]: DEBUG nova.virt.images [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] 37c4dd9c-00ef-4628-a52b-08bbc83729ca was qcow2, converting to raw {{(pid=74540) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 07 04:31:15 user nova-compute[74540]: DEBUG nova.privsep.utils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74540) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 07 04:31:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58.part /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58.converted {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:15 user nova-compute[74540]: DEBUG nova.network.neutron [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Successfully created port: ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58.part /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58.converted" returned: 0 in 0.553s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58.converted --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "e64b2c83031ec7165afd435e4ccb897e2c3f0a58" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.636s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG nova.network.neutron [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Successfully updated port: ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquired lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG nova.network.neutron [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG nova.compute.manager [req-c07af3ad-e198-4d98-8d0b-45939b53e200 req-388046de-98e7-48e2-8190-a2a0b86ab0d7 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-changed-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG nova.compute.manager [req-c07af3ad-e198-4d98-8d0b-45939b53e200 req-388046de-98e7-48e2-8190-a2a0b86ab0d7 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Refreshing instance network info cache due to event network-changed-ab82e983-c662-4173-a423-00d4c5fb77f2. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c07af3ad-e198-4d98-8d0b-45939b53e200 req-388046de-98e7-48e2-8190-a2a0b86ab0d7 service nova] Acquiring lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58 --force-share --output=json" returned: 0 in 0.193s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "e64b2c83031ec7165afd435e4ccb897e2c3f0a58" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "e64b2c83031ec7165afd435e4ccb897e2c3f0a58" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:16 user nova-compute[74540]: DEBUG nova.network.neutron [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58 --force-share --output=json" returned: 0 in 0.197s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58,backing_fmt=raw /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58,backing_fmt=raw /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk 1073741824" returned: 0 in 0.053s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "e64b2c83031ec7165afd435e4ccb897e2c3f0a58" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58 --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.network.neutron [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updating instance_info_cache with network_info: [{"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Releasing lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Instance network_info: |[{"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c07af3ad-e198-4d98-8d0b-45939b53e200 req-388046de-98e7-48e2-8190-a2a0b86ab0d7 service nova] Acquired lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.network.neutron [req-c07af3ad-e198-4d98-8d0b-45939b53e200 req-388046de-98e7-48e2-8190-a2a0b86ab0d7 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Refreshing network info cache for port ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58 --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Cannot resize image /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Ensure instance console log exists: /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Start _get_guest_xml network_info=[{"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T04:31:12Z,direct_url=<?>,disk_format='qcow2',id=37c4dd9c-00ef-4628-a52b-08bbc83729ca,min_disk=0,min_ram=0,name='tempest-scenario-img--1458403568',owner='92bc5f60b66347ca8404e1553ec719d7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T04:31:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': '37c4dd9c-00ef-4628-a52b-08bbc83729ca'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:31:17 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:31:17 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T04:31:12Z,direct_url=<?>,disk_format='qcow2',id=37c4dd9c-00ef-4628-a52b-08bbc83729ca,min_disk=0,min_ram=0,name='tempest-scenario-img--1458403568',owner='92bc5f60b66347ca8404e1553ec719d7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T04:31:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-905414929',display_name='tempest-TestMinimumBasicScenario-server-905414929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-905414929',id=45,image_ref='37c4dd9c-00ef-4628-a52b-08bbc83729ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlqAZrGHBDkVsJ4Cvb3L4YkeBkBrH6zGqmA61h2smVD++I5kBA1mBJhJVWaI9IkrFHu/M9hsEF0DD9bmgdXWOilayw1/qwTYYgzM+9/W92rHSr7BsCuldxbn27uvSJJPg==',key_name='tempest-TestMinimumBasicScenario-1047564483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bc5f60b66347ca8404e1553ec719d7',ramdisk_id='',reservation_id='r-0pcy97q3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='37c4dd9c-00ef-4628-a52b-08bbc83729ca',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-702707071',owner_user_name='tempest-TestMinimumBasicScenario-702707071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:31:15Z,user_data=None,user_id='48997d7730cb406dbf7d127224a52543',uuid=94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converting VIF {"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:c2,bridge_name='br-int',has_traffic_filtering=True,id=ab82e983-c662-4173-a423-00d4c5fb77f2,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab82e983-c6') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.objects.instance [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'pci_devices' on Instance uuid 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:31:17 user nova-compute[74540]:   <uuid>94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4</uuid>
Nov 07 04:31:17 user nova-compute[74540]:   <name>instance-0000002d</name>
Nov 07 04:31:17 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:31:17 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:31:17 user nova-compute[74540]:   <metadata>
Nov 07 04:31:17 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:31:17 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:31:17 user nova-compute[74540]:       <nova:name>tempest-TestMinimumBasicScenario-server-905414929</nova:name>
Nov 07 04:31:17 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:31:17</nova:creationTime>
Nov 07 04:31:17 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:31:17 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:31:17 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:31:17 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:31:17 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:31:17 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:31:17 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:31:17 user nova-compute[74540]:       <nova:owner>
Nov 07 04:31:17 user nova-compute[74540]:         <nova:user uuid="48997d7730cb406dbf7d127224a52543">tempest-TestMinimumBasicScenario-702707071-project-member</nova:user>
Nov 07 04:31:17 user nova-compute[74540]:         <nova:project uuid="92bc5f60b66347ca8404e1553ec719d7">tempest-TestMinimumBasicScenario-702707071</nova:project>
Nov 07 04:31:17 user nova-compute[74540]:       </nova:owner>
Nov 07 04:31:17 user nova-compute[74540]:       <nova:root type="image" uuid="37c4dd9c-00ef-4628-a52b-08bbc83729ca"/>
Nov 07 04:31:17 user nova-compute[74540]:       <nova:ports>
Nov 07 04:31:17 user nova-compute[74540]:         <nova:port uuid="ab82e983-c662-4173-a423-00d4c5fb77f2">
Nov 07 04:31:17 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 07 04:31:17 user nova-compute[74540]:         </nova:port>
Nov 07 04:31:17 user nova-compute[74540]:       </nova:ports>
Nov 07 04:31:17 user nova-compute[74540]:     </nova:instance>
Nov 07 04:31:17 user nova-compute[74540]:   </metadata>
Nov 07 04:31:17 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:31:17 user nova-compute[74540]:     <system>
Nov 07 04:31:17 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:31:17 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:31:17 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:31:17 user nova-compute[74540]:       <entry name="serial">94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4</entry>
Nov 07 04:31:17 user nova-compute[74540]:       <entry name="uuid">94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4</entry>
Nov 07 04:31:17 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:31:17 user nova-compute[74540]:     </system>
Nov 07 04:31:17 user nova-compute[74540]:   </sysinfo>
Nov 07 04:31:17 user nova-compute[74540]:   <os>
Nov 07 04:31:17 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:31:17 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:31:17 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:31:17 user nova-compute[74540]:   </os>
Nov 07 04:31:17 user nova-compute[74540]:   <features>
Nov 07 04:31:17 user nova-compute[74540]:     <acpi/>
Nov 07 04:31:17 user nova-compute[74540]:     <apic/>
Nov 07 04:31:17 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:31:17 user nova-compute[74540]:   </features>
Nov 07 04:31:17 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:31:17 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:31:17 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:31:17 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:31:17 user nova-compute[74540]:   </clock>
Nov 07 04:31:17 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:31:17 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:31:17 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:31:17 user nova-compute[74540]:   </cpu>
Nov 07 04:31:17 user nova-compute[74540]:   <devices>
Nov 07 04:31:17 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:31:17 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:31:17 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk"/>
Nov 07 04:31:17 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:31:17 user nova-compute[74540]:     </disk>
Nov 07 04:31:17 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:31:17 user nova-compute[74540]:       <mac address="fa:16:3e:b4:73:c2"/>
Nov 07 04:31:17 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:31:17 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:31:17 user nova-compute[74540]:       <target dev="tapab82e983-c6"/>
Nov 07 04:31:17 user nova-compute[74540]:     </interface>
Nov 07 04:31:17 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:31:17 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/console.log" append="off"/>
Nov 07 04:31:17 user nova-compute[74540]:     </serial>
Nov 07 04:31:17 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:31:17 user nova-compute[74540]:     <video>
Nov 07 04:31:17 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:31:17 user nova-compute[74540]:     </video>
Nov 07 04:31:17 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:31:17 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:31:17 user nova-compute[74540]:     </rng>
Nov 07 04:31:17 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:31:17 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:31:17 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:31:17 user nova-compute[74540]:     </memballoon>
Nov 07 04:31:17 user nova-compute[74540]:   </devices>
Nov 07 04:31:17 user nova-compute[74540]: </domain>
Nov 07 04:31:17 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-905414929',display_name='tempest-TestMinimumBasicScenario-server-905414929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-905414929',id=45,image_ref='37c4dd9c-00ef-4628-a52b-08bbc83729ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlqAZrGHBDkVsJ4Cvb3L4YkeBkBrH6zGqmA61h2smVD++I5kBA1mBJhJVWaI9IkrFHu/M9hsEF0DD9bmgdXWOilayw1/qwTYYgzM+9/W92rHSr7BsCuldxbn27uvSJJPg==',key_name='tempest-TestMinimumBasicScenario-1047564483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bc5f60b66347ca8404e1553ec719d7',ramdisk_id='',reservation_id='r-0pcy97q3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='37c4dd9c-00ef-4628-a52b-08bbc83729ca',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-702707071',owner_user_name='tempest-TestMinimumBasicScenario-702707071-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:31:15Z,user_data=None,user_id='48997d7730cb406dbf7d127224a52543',uuid=94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converting VIF {"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:c2,bridge_name='br-int',has_traffic_filtering=True,id=ab82e983-c662-4173-a423-00d4c5fb77f2,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab82e983-c6') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG os_vif [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:c2,bridge_name='br-int',has_traffic_filtering=True,id=ab82e983-c662-4173-a423-00d4c5fb77f2,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab82e983-c6') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e0048c6-a65a-596e-825a-ca2fa6430508', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab82e983-c6, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab82e983-c6, col_values=(('qos', UUID('c1808455-e3bb-413b-94ef-801404dbd085')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab82e983-c6, col_values=(('external_ids', {'iface-id': 'ab82e983-c662-4173-a423-00d4c5fb77f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:73:c2', 'vm-uuid': '94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:17 user nova-compute[74540]: INFO os_vif [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:c2,bridge_name='br-int',has_traffic_filtering=True,id=ab82e983-c662-4173-a423-00d4c5fb77f2,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab82e983-c6')
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] No VIF found with MAC fa:16:3e:b4:73:c2, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.network.neutron [req-c07af3ad-e198-4d98-8d0b-45939b53e200 req-388046de-98e7-48e2-8190-a2a0b86ab0d7 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updated VIF entry in instance network info cache for port ab82e983-c662-4173-a423-00d4c5fb77f2. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG nova.network.neutron [req-c07af3ad-e198-4d98-8d0b-45939b53e200 req-388046de-98e7-48e2-8190-a2a0b86ab0d7 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updating instance_info_cache with network_info: [{"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:31:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c07af3ad-e198-4d98-8d0b-45939b53e200 req-388046de-98e7-48e2-8190-a2a0b86ab0d7 service nova] Releasing lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:31:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-3f2e2e28-bd9e-4884-b3f0-2f8dbb69536e req-22189374-590a-426c-950b-825f7bdb8ae9 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:31:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3f2e2e28-bd9e-4884-b3f0-2f8dbb69536e req-22189374-590a-426c-950b-825f7bdb8ae9 service nova] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3f2e2e28-bd9e-4884-b3f0-2f8dbb69536e req-22189374-590a-426c-950b-825f7bdb8ae9 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3f2e2e28-bd9e-4884-b3f0-2f8dbb69536e req-22189374-590a-426c-950b-825f7bdb8ae9 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:31:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-3f2e2e28-bd9e-4884-b3f0-2f8dbb69536e req-22189374-590a-426c-950b-825f7bdb8ae9 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] No waiting events found dispatching network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:31:19 user nova-compute[74540]: WARNING nova.compute.manager [req-3f2e2e28-bd9e-4884-b3f0-2f8dbb69536e req-22189374-590a-426c-950b-825f7bdb8ae9 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received unexpected event network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 for instance with vm_state building and task_state spawning.
Nov 07 04:31:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:31:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Instance spawned successfully.
Nov 07 04:31:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:31:21 user nova-compute[74540]: INFO nova.compute.manager [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Took 6.29 seconds to spawn the instance on the hypervisor.
Nov 07 04:31:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-98c16f18-e1f9-493d-8924-aa6db7d80911 req-3e6d2f3d-6ef8-45c6-abe6-4aae12e77601 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-98c16f18-e1f9-493d-8924-aa6db7d80911 req-3e6d2f3d-6ef8-45c6-abe6-4aae12e77601 service nova] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-98c16f18-e1f9-493d-8924-aa6db7d80911 req-3e6d2f3d-6ef8-45c6-abe6-4aae12e77601 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-98c16f18-e1f9-493d-8924-aa6db7d80911 req-3e6d2f3d-6ef8-45c6-abe6-4aae12e77601 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-98c16f18-e1f9-493d-8924-aa6db7d80911 req-3e6d2f3d-6ef8-45c6-abe6-4aae12e77601 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] No waiting events found dispatching network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:31:21 user nova-compute[74540]: WARNING nova.compute.manager [req-98c16f18-e1f9-493d-8924-aa6db7d80911 req-3e6d2f3d-6ef8-45c6-abe6-4aae12e77601 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received unexpected event network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 for instance with vm_state building and task_state spawning.
Nov 07 04:31:21 user nova-compute[74540]: INFO nova.compute.manager [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Took 6.91 seconds to build instance.
Nov 07 04:31:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-5d3656a8-5c4b-4ed3-acfc-6dbabba4e57c tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.017s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:31:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEcvVnjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:31:36 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:31:36 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:31:36 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1265a5ec-8017-4a33-8ea0-f4e0794c8ffd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:31:36 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f53252-0514-41f1-97f8-23a58f0ca962]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3] added
Nov 07 04:31:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[059e7060-e5da-4d17-bf45-110850036196]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf960a9f-11ef-40a8-ba0e-aaeebde0fd3c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEcvVnjt {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEcvVnjt" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[05335194-5f2f-4776-a70d-e8263723ff8e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CEcvVnjt'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b598e841-19a3-409e-85b2-cadffa3d4e82]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56a3785-d54b-49c9-8969-3f7f85468e7e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:31:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:31:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a19a4bf-ae5d-42a1-be18-5f97d3a21525]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3, portal: 172.16.0.220,3260]
Nov 07 04:31:36 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3, portal: 172.16.0.220,3260] successful.
Nov 07 04:31:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18e8cd6-b5bd-4cbd-82fe-50c2aec8ab36]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bbf861-e180-42cd-b79e-e0763326d120]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:31:36 user nova-compute[74540]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 (non-flash)
Nov 07 04:31:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:31:36 user nova-compute[74540]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 (non-flash)
Nov 07 04:31:36 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18e5bf1-f211-4e9f-818e-900b6293e98f]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:31:36 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:31:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:37 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:31:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEcvVnjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:31:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:31:37 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26135646231363834', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:31:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135646231363834', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:31:37 user nova-compute[74540]: DEBUG nova.objects.instance [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lazy-loading 'flavor' on Instance uuid 5d79fc2a-182b-47f5-bec1-5505591f4539 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:31:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:31:37 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:31:37 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:31:37 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:31:37 user nova-compute[74540]:   <serial>4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3</serial>
Nov 07 04:31:37 user nova-compute[74540]: </disk>
Nov 07 04:31:37 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:31:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:31:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:31:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] No VIF found with MAC fa:16:3e:f7:1f:7e, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:31:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a3b31e14-0b93-4a00-8393-bd8c0d6f8ac2 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.262s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:31:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "5d79fc2a-182b-47f5-bec1-5505591f4539" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:31:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:31:39 user nova-compute[74540]: INFO nova.compute.manager [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Detaching volume 4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3
Nov 07 04:31:39 user nova-compute[74540]: INFO nova.virt.block_device [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Attempting to driver detach volume 4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 from mountpoint /dev/vdb
Nov 07 04:31:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Attempting to detach device vdb from instance 5d79fc2a-182b-47f5-bec1-5505591f4539 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:31:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:31:39 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:31:39 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:31:39 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:31:39 user nova-compute[74540]:   <serial>4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3</serial>
Nov 07 04:31:39 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:31:39 user nova-compute[74540]: </disk>
Nov 07 04:31:39 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:31:39 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Successfully detached device vdb from instance 5d79fc2a-182b-47f5-bec1-5505591f4539 from the persistent domain config.
Nov 07 04:31:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d79fc2a-182b-47f5-bec1-5505591f4539 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:31:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:31:39 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:31:39 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:31:39 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:31:39 user nova-compute[74540]:   <serial>4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3</serial>
Nov 07 04:31:39 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:31:39 user nova-compute[74540]: </disk>
Nov 07 04:31:39 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:31:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d79fc2a-182b-47f5-bec1-5505591f4539 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:31:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:54 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:31:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:31:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:31:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:31:57 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:31:57 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:00 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5d79fc2a-182b-47f5-bec1-5505591f4539 is timed out.
Nov 07 04:32:00 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Successfully detached device vdb from instance 5d79fc2a-182b-47f5-bec1-5505591f4539 from the live domain config.
Nov 07 04:32:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEcvVnjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:32:00 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5837f9-119b-4013-a0a8-7fc6efac866d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:32:00 user nova-compute[74540]: No targets found.
Nov 07 04:32:00 user nova-compute[74540]: iSNS:
Nov 07 04:32:00 user nova-compute[74540]: No targets found.
Nov 07 04:32:00 user nova-compute[74540]: STATIC:
Nov 07 04:32:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a
Nov 07 04:32:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:32:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:32:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3
Nov 07 04:32:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:32:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:32:00 user nova-compute[74540]: FIRMWARE:
Nov 07 04:32:00 user nova-compute[74540]: No targets found.
Nov 07 04:32:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:32:00 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:32:00 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[94530e02-1e8a-402b-af3f-fa178d118192]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[796c2df2-e93f-4c4a-8b19-408e59d302e8]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:32:00 user nova-compute[74540]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 (non-flash)
Nov 07 04:32:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:32:00 user nova-compute[74540]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 (non-flash)
Nov 07 04:32:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc39e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7724e5ee-544f-4405-903c-138f12fcfe7a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed1e2f-d786-411f-91b9-c922ec29f7c8]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8173c6af-7754-48bc-bf43-879bb580960c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe9bd11-43c4-462d-9c0f-ab00f7f120d2]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[20da13d0-301d-479e-a6a4-b36efd779d17]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fb0aa8-6315-4e29-b3a8-8e873d7b093f]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3, portal: 172.16.0.220,3260]
Nov 07 04:32:00 user nova-compute[74540]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3, portal: 172.16.0.220,3260] successful.
Nov 07 04:32:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f1ba64f-5851-45fa-9b1d-e5c51e0aafb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c041150e-665b-450c-8793-b82b3d6b2e42]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] <== disconnect_volume: return (280ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:32:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:32:01 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:01 user nova-compute[74540]: DEBUG nova.objects.instance [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lazy-loading 'flavor' on Instance uuid 5d79fc2a-182b-47f5-bec1-5505591f4539 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:32:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-34ebb103-2e27-44b8-85a0-8c3d4307b430 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.144s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:32:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:32:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:32:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:32:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:05 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:32:07 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:07 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:32:07 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:32:07 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:08 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:09 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:32:09 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:32:09 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=24.777023315429688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:32:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:09 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d79fc2a-182b-47f5-bec1-5505591f4539 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:32:09 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 26890199-c159-45e4-9d69-08497f81d5c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:32:09 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:32:09 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:32:09 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:32:09 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:32:09 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:32:09 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:32:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:32:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:32:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:32:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:32:11 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:32:11 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 5d79fc2a-182b-47f5-bec1-5505591f4539 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:32:11 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Updating instance_info_cache with network_info: [{"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:32:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-5d79fc2a-182b-47f5-bec1-5505591f4539" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:32:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:32:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-56f98aff-6e38-4179-9823-6557bf9117cb req-35791c9a-71d3-43f5-bcda-55c93d4e57ee service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-changed-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG nova.compute.manager [req-56f98aff-6e38-4179-9823-6557bf9117cb req-35791c9a-71d3-43f5-bcda-55c93d4e57ee service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Refreshing instance network info cache due to event network-changed-7e6e59a5-614a-4fe8-ab91-bdf847c4209e. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-56f98aff-6e38-4179-9823-6557bf9117cb req-35791c9a-71d3-43f5-bcda-55c93d4e57ee service nova] Acquiring lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-56f98aff-6e38-4179-9823-6557bf9117cb req-35791c9a-71d3-43f5-bcda-55c93d4e57ee service nova] Acquired lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-56f98aff-6e38-4179-9823-6557bf9117cb req-35791c9a-71d3-43f5-bcda-55c93d4e57ee service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Refreshing network info cache for port 7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "26890199-c159-45e4-9d69-08497f81d5c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:18 user nova-compute[74540]: INFO nova.compute.manager [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Terminating instance
Nov 07 04:32:18 user nova-compute[74540]: DEBUG nova.compute.manager [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-56f98aff-6e38-4179-9823-6557bf9117cb req-35791c9a-71d3-43f5-bcda-55c93d4e57ee service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updated VIF entry in instance network info cache for port 7e6e59a5-614a-4fe8-ab91-bdf847c4209e. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG nova.network.neutron [req-56f98aff-6e38-4179-9823-6557bf9117cb req-35791c9a-71d3-43f5-bcda-55c93d4e57ee service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updating instance_info_cache with network_info: [{"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-3e089460-3a61-4244-83c8-60247919e22b req-bbf1273d-b78f-468e-a077-853f5d294b33 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-vif-unplugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3e089460-3a61-4244-83c8-60247919e22b req-bbf1273d-b78f-468e-a077-853f5d294b33 service nova] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3e089460-3a61-4244-83c8-60247919e22b req-bbf1273d-b78f-468e-a077-853f5d294b33 service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3e089460-3a61-4244-83c8-60247919e22b req-bbf1273d-b78f-468e-a077-853f5d294b33 service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-3e089460-3a61-4244-83c8-60247919e22b req-bbf1273d-b78f-468e-a077-853f5d294b33 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] No waiting events found dispatching network-vif-unplugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-3e089460-3a61-4244-83c8-60247919e22b req-bbf1273d-b78f-468e-a077-853f5d294b33 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-vif-unplugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-56f98aff-6e38-4179-9823-6557bf9117cb req-35791c9a-71d3-43f5-bcda-55c93d4e57ee service nova] Releasing lock "refresh_cache-26890199-c159-45e4-9d69-08497f81d5c2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:32:19 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Instance destroyed successfully.
Nov 07 04:32:19 user nova-compute[74540]: DEBUG nova.objects.instance [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lazy-loading 'resources' on Instance uuid 26890199-c159-45e4-9d69-08497f81d5c2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-07T04:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-707186112',display_name='tempest-TestShelveInstance-server-707186112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-707186112',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANy3Hf05eA8Uao7ke4zYpDwI2ZJAlLySHnaLwNxrbFZ1mnbZhcv+IFwZq9Hcnhjlrfh/wz5C28+C6yR1LiJlaQPXFaVWzpl1YT74QjHyZN5OUDEqDzeySQfMbDvymXpnw==',key_name='tempest-TestShelveInstance-1395746955',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:30:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='973e71d3c5dd4e268defadc32013ea39',ramdisk_id='',reservation_id='r-ulrbyx8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1609380101',owner_user_name='tempest-TestShelveInstance-1609380101-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:30:56Z,user_data=None,user_id='15f998264d6c4ddf89f55894400758cb',uuid=26890199-c159-45e4-9d69-08497f81d5c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Converting VIF {"id": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "address": "fa:16:3e:0d:12:8f", "network": {"id": "c885fe3d-59f4-4c64-939b-358fa49279b5", "bridge": "br-int", "label": "tempest-TestShelveInstance-452214203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "973e71d3c5dd4e268defadc32013ea39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e6e59a5-61", "ovs_interfaceid": "7e6e59a5-614a-4fe8-ab91-bdf847c4209e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_vif [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e6e59a5-61, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=744ede93-fbdb-4d47-aad5-f643b4f5dbc4) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:19 user nova-compute[74540]: INFO os_vif [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=7e6e59a5-614a-4fe8-ab91-bdf847c4209e,network=Network(c885fe3d-59f4-4c64-939b-358fa49279b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e6e59a5-61')
Nov 07 04:32:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdxcXUkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:32:19 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fff2bb-104c-41c7-b983-c4fbdc4d55fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:32:19 user nova-compute[74540]: No targets found.
Nov 07 04:32:19 user nova-compute[74540]: iSNS:
Nov 07 04:32:19 user nova-compute[74540]: No targets found.
Nov 07 04:32:19 user nova-compute[74540]: STATIC:
Nov 07 04:32:19 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a
Nov 07 04:32:19 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:32:19 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:32:19 user nova-compute[74540]: FIRMWARE:
Nov 07 04:32:19 user nova-compute[74540]: No targets found.
Nov 07 04:32:19 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:32:19 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:32:19 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a949df6-34d4-48a5-932c-6933c491daad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[691e2455-da39-439e-8dff-75786c15a695]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:32:19 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a (non-flash)
Nov 07 04:32:19 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc38d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e50104-476e-4e8c-bcad-94c3095e9cea]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c86c691-78e2-408b-a254-427ba0eff9b9]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba71090b-ba2d-494c-89a4-16fabe15d9a9]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.140s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[667044ab-677b-4c36-95e9-9130f0202abd]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf25924d2-2787407f610e3289', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f25924d2', '/dev/disk/by-id/scsi-23237383734303766') {{(pid=85868) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efa6645-ab9c-4aaf-aaf4-cd3a253c5325]: (4, None) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[026fe861-bee5-4137-a183-75516b1bad84]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a30b2b-4407-4db3-a34d-0bc25ffd6347]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260]
Nov 07 04:32:19 user nova-compute[74540]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a, portal: 172.16.0.220,3260] successful.
Nov 07 04:32:19 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7719ba97-3b4a-43e1-96b0-ce5fca24be6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af21e99-5f2e-4253-8e0f-99185cfc1f13]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] <== disconnect_volume: return (394ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:32:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:32:19 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Deleting instance files /opt/stack/data/nova/instances/26890199-c159-45e4-9d69-08497f81d5c2_del
Nov 07 04:32:19 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Deletion of /opt/stack/data/nova/instances/26890199-c159-45e4-9d69-08497f81d5c2_del complete
Nov 07 04:32:20 user nova-compute[74540]: INFO nova.compute.manager [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 07 04:32:20 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:32:20 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:32:20 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:32:20 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:32:21 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Took 0.98 seconds to deallocate network for instance.
Nov 07 04:32:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-eea3a1a8-bb6a-46af-8d11-9284013e4a3c req-b51c583f-1262-4fb7-aa51-8f0d05beb02e service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-vif-deleted-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:32:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-468329dc-c98e-4519-8b92-1ba970ef853f req-64202c95-a95f-441b-a3c8-ce1670fdc3c1 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received event network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:32:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-468329dc-c98e-4519-8b92-1ba970ef853f req-64202c95-a95f-441b-a3c8-ce1670fdc3c1 service nova] Acquiring lock "26890199-c159-45e4-9d69-08497f81d5c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-468329dc-c98e-4519-8b92-1ba970ef853f req-64202c95-a95f-441b-a3c8-ce1670fdc3c1 service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-468329dc-c98e-4519-8b92-1ba970ef853f req-64202c95-a95f-441b-a3c8-ce1670fdc3c1 service nova] Lock "26890199-c159-45e4-9d69-08497f81d5c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-468329dc-c98e-4519-8b92-1ba970ef853f req-64202c95-a95f-441b-a3c8-ce1670fdc3c1 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] No waiting events found dispatching network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:32:21 user nova-compute[74540]: WARNING nova.compute.manager [req-468329dc-c98e-4519-8b92-1ba970ef853f req-64202c95-a95f-441b-a3c8-ce1670fdc3c1 service nova] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Received unexpected event network-vif-plugged-7e6e59a5-614a-4fe8-ab91-bdf847c4209e for instance with vm_state active and task_state deleting.
Nov 07 04:32:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:21 user nova-compute[74540]: INFO nova.compute.manager [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Took 0.88 seconds to detach 1 volumes for instance.
Nov 07 04:32:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] [instance: 26890199-c159-45e4-9d69-08497f81d5c2] Deleting volume: 7719ba97-3b4a-43e1-96b0-ce5fca24be6a {{(pid=74540) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:22 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Deleted allocations for instance 26890199-c159-45e4-9d69-08497f81d5c2
Nov 07 04:32:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-76b1db97-f838-4880-9eba-3a6a12a36433 tempest-TestShelveInstance-1609380101 tempest-TestShelveInstance-1609380101-project-member] Lock "26890199-c159-45e4-9d69-08497f81d5c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.581s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Verify base images {{(pid=74540) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Image id 37c4dd9c-00ef-4628-a52b-08bbc83729ca yields fingerprint e64b2c83031ec7165afd435e4ccb897e2c3f0a58 {{(pid=74540) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 07 04:32:22 user nova-compute[74540]: INFO nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] image 37c4dd9c-00ef-4628-a52b-08bbc83729ca at (/opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58): checking
Nov 07 04:32:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] image 37c4dd9c-00ef-4628-a52b-08bbc83729ca at (/opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58): image is in use {{(pid=74540) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74540) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Image id b2fc4ee2-830c-4852-b2e5-8dcdd33e1718 yields fingerprint 00a371a3b6100eef317a2082590c0cb2e358b94c {{(pid=74540) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 07 04:32:22 user nova-compute[74540]: INFO nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] image b2fc4ee2-830c-4852-b2e5-8dcdd33e1718 at (/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c): checking
Nov 07 04:32:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] image b2fc4ee2-830c-4852-b2e5-8dcdd33e1718 at (/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c): image is in use {{(pid=74540) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 is a valid instance name {{(pid=74540) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 has a disk file {{(pid=74540) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 07 04:32:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 is backed by e64b2c83031ec7165afd435e4ccb897e2c3f0a58 {{(pid=74540) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 07 04:32:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] 5d79fc2a-182b-47f5-bec1-5505591f4539 is a valid instance name {{(pid=74540) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 07 04:32:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] 5d79fc2a-182b-47f5-bec1-5505591f4539 has a disk file {{(pid=74540) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 07 04:32:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:32:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:32:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 5d79fc2a-182b-47f5-bec1-5505591f4539 is backed by 00a371a3b6100eef317a2082590c0cb2e358b94c {{(pid=74540) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 07 04:32:23 user nova-compute[74540]: WARNING nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817
Nov 07 04:32:23 user nova-compute[74540]: WARNING nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Unknown base file: /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01
Nov 07 04:32:23 user nova-compute[74540]: WARNING nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c
Nov 07 04:32:23 user nova-compute[74540]: WARNING nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137
Nov 07 04:32:23 user nova-compute[74540]: WARNING nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Unknown base file: /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5
Nov 07 04:32:23 user nova-compute[74540]: WARNING nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f
Nov 07 04:32:23 user nova-compute[74540]: WARNING nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0
Nov 07 04:32:23 user nova-compute[74540]: WARNING nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de
Nov 07 04:32:23 user nova-compute[74540]: INFO nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Active base files: /opt/stack/data/nova/instances/_base/e64b2c83031ec7165afd435e4ccb897e2c3f0a58 /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c
Nov 07 04:32:23 user nova-compute[74540]: INFO nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Removable base files: /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817 /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01 /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137 /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5 /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0 /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de
Nov 07 04:32:23 user nova-compute[74540]: INFO nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fd4daa67cef396176fb29a99dc9e98ee5e1ea817
Nov 07 04:32:23 user nova-compute[74540]: INFO nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/efe2d283e12f6cc2b50f998bfe9e21cada1a9a01
Nov 07 04:32:23 user nova-compute[74540]: INFO nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c006b62192ca4015ad8f8370aea357cfd7efff3c
Nov 07 04:32:23 user nova-compute[74540]: INFO nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cf9b503f00246873abd2ac0e0951c6269736f137
Nov 07 04:32:23 user nova-compute[74540]: INFO nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/15a0999fd209bcc06b0d12a21aee3cf9f09624f5
Nov 07 04:32:23 user nova-compute[74540]: INFO nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0ae478179083b1cf024a5a48c74b1b419b911a9f
Nov 07 04:32:23 user nova-compute[74540]: INFO nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cb6b3f685290481b51d08c4fe3fd634dceba6ed0
Nov 07 04:32:23 user nova-compute[74540]: INFO nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7e21b159470e91fd835d8a5ab1b2563527a161de
Nov 07 04:32:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Verification complete {{(pid=74540) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 07 04:32:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Verify swap images {{(pid=74540) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 07 04:32:23 user nova-compute[74540]: DEBUG nova.virt.libvirt.imagecache [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Verify ephemeral images {{(pid=74540) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 07 04:32:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:32:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:32:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:32:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:32:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:32:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:32:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:32:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:32:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "5d79fc2a-182b-47f5-bec1-5505591f4539" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:42 user nova-compute[74540]: INFO nova.compute.manager [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Terminating instance
Nov 07 04:32:42 user nova-compute[74540]: DEBUG nova.compute.manager [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG nova.compute.manager [req-bfa6d934-1562-454d-aa5c-3a1e59e133b2 req-f94adda5-72e4-428b-97e5-3df63d06ad14 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Received event network-vif-unplugged-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bfa6d934-1562-454d-aa5c-3a1e59e133b2 req-f94adda5-72e4-428b-97e5-3df63d06ad14 service nova] Acquiring lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bfa6d934-1562-454d-aa5c-3a1e59e133b2 req-f94adda5-72e4-428b-97e5-3df63d06ad14 service nova] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bfa6d934-1562-454d-aa5c-3a1e59e133b2 req-f94adda5-72e4-428b-97e5-3df63d06ad14 service nova] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG nova.compute.manager [req-bfa6d934-1562-454d-aa5c-3a1e59e133b2 req-f94adda5-72e4-428b-97e5-3df63d06ad14 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] No waiting events found dispatching network-vif-unplugged-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG nova.compute.manager [req-bfa6d934-1562-454d-aa5c-3a1e59e133b2 req-f94adda5-72e4-428b-97e5-3df63d06ad14 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Received event network-vif-unplugged-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:32:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Instance destroyed successfully.
Nov 07 04:32:42 user nova-compute[74540]: DEBUG nova.objects.instance [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lazy-loading 'resources' on Instance uuid 5d79fc2a-182b-47f5-bec1-5505591f4539 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:29:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-735742575',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-735742575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7357425',id=44,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPZAnwWkRUtPreBpye4Fg6smQbY+PkOG02vqNvOICpAxkDEMgc1t1wzB4jYTYX5Ad6jxjRVfLVj4HdCK5LjFc32HGYpOLwM3Cxci5nBf5SNSvsj3FGdYDvlODAXfrRD1A==',key_name='tempest-keypair-1959887095',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:29:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='120c7af771a74fbea86b645109eb9c39',ramdisk_id='',reservation_id='r-ih5wdbu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-515724616',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:29:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f3aed6c53894c1b81bcbf75a78f164f',uuid=5d79fc2a-182b-47f5-bec1-5505591f4539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Converting VIF {"id": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "address": "fa:16:3e:f7:1f:7e", "network": {"id": "e48116ca-35ca-4daa-a480-c8ca1c426b5c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1226857003-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "120c7af771a74fbea86b645109eb9c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ae3793c-0c", "ovs_interfaceid": "7ae3793c-0cb0-4ff6-a159-2509d44bc8b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:1f:7e,bridge_name='br-int',has_traffic_filtering=True,id=7ae3793c-0cb0-4ff6-a159-2509d44bc8b6,network=Network(e48116ca-35ca-4daa-a480-c8ca1c426b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae3793c-0c') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG os_vif [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:1f:7e,bridge_name='br-int',has_traffic_filtering=True,id=7ae3793c-0cb0-4ff6-a159-2509d44bc8b6,network=Network(e48116ca-35ca-4daa-a480-c8ca1c426b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae3793c-0c') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ae3793c-0c, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc55b503-5345-402d-a26a-d956c9dbd670) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:32:42 user nova-compute[74540]: INFO os_vif [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:1f:7e,bridge_name='br-int',has_traffic_filtering=True,id=7ae3793c-0cb0-4ff6-a159-2509d44bc8b6,network=Network(e48116ca-35ca-4daa-a480-c8ca1c426b5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ae3793c-0c')
Nov 07 04:32:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Deleting instance files /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539_del
Nov 07 04:32:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Deletion of /opt/stack/data/nova/instances/5d79fc2a-182b-47f5-bec1-5505591f4539_del complete
Nov 07 04:32:42 user nova-compute[74540]: INFO nova.compute.manager [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 07 04:32:42 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:32:42 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:32:43 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:32:43 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Took 0.76 seconds to deallocate network for instance.
Nov 07 04:32:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-e4cdaff3-6045-47b9-b9fb-23d891bdad68 req-d4ea198c-d635-4c4c-a32c-f476914bc40d service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Received event network-vif-deleted-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:32:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:43 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:32:43 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:32:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:43 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Deleted allocations for instance 5d79fc2a-182b-47f5-bec1-5505591f4539
Nov 07 04:32:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-bbf3baa8-c4d3-4363-a92d-abd73f717ed3 tempest-TestServerVolumeAttachScenarioOldVersion-515724616 tempest-TestServerVolumeAttachScenarioOldVersion-515724616-project-member] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.998s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-1fc5d99e-e93c-4501-a8ae-1c70e9225f90 req-b74865b3-0413-4bab-819f-a794425b0335 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Received event network-vif-plugged-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:32:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1fc5d99e-e93c-4501-a8ae-1c70e9225f90 req-b74865b3-0413-4bab-819f-a794425b0335 service nova] Acquiring lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:32:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1fc5d99e-e93c-4501-a8ae-1c70e9225f90 req-b74865b3-0413-4bab-819f-a794425b0335 service nova] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:32:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1fc5d99e-e93c-4501-a8ae-1c70e9225f90 req-b74865b3-0413-4bab-819f-a794425b0335 service nova] Lock "5d79fc2a-182b-47f5-bec1-5505591f4539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:32:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-1fc5d99e-e93c-4501-a8ae-1c70e9225f90 req-b74865b3-0413-4bab-819f-a794425b0335 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] No waiting events found dispatching network-vif-plugged-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:32:44 user nova-compute[74540]: WARNING nova.compute.manager [req-1fc5d99e-e93c-4501-a8ae-1c70e9225f90 req-b74865b3-0413-4bab-819f-a794425b0335 service nova] [instance: 5d79fc2a-182b-47f5-bec1-5505591f4539] Received unexpected event network-vif-plugged-7ae3793c-0cb0-4ff6-a159-2509d44bc8b6 for instance with vm_state deleted and task_state None.
Nov 07 04:32:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:32:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:32:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:32:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:32:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:53 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:55 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:56 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:57 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:32:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:32:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:32:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:32:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:32:58 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:58 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:32:58 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:33:00 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:33:00 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74540) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 04:33:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:33:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:33:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:06 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:33:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:09 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:33:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:09 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:33:09 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:10 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:33:10 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:33:10 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=24.802398681640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG nova.objects.instance [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'flavor' on Instance uuid 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:10 user nova-compute[74540]: INFO nova.compute.manager [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Attaching volume c6a1d559-0670-44c7-b634-70a6a177a061 to /dev/vdb
Nov 07 04:33:10 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:33:10 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing inventories for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG os_brick.utils [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating ProviderTree inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c1f7c-0595-474f-911a-c7064c6ed624]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing aggregate associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, aggregates: None {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ec8c24-d268-4f82-b070-b71006ed9e4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4342eb67-1fd0-46b8-9eeb-61e2e067f996]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72af9bf-f5fc-45c4-90bd-fecb88166e97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing trait associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:33:11 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0452a7ec-6470-40e3-bba9-850795ee8809]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG os_brick.utils [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updating existing volume attachment record: 5c7a74f7-7153-408e-8265-2316c8b3dca0 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] There are 0 instances to clean {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 04:33:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:13 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:33:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:33:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:33:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:33:13 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:33:13 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updating instance_info_cache with network_info: [{"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:33:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:33:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:33:15 user nova-compute[74540]: INFO nova.compute.claims [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Claim successful on node user
Nov 07 04:33:15 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG nova.network.neutron [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:33:15 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:33:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG nova.policy [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55a21121d30244e98c7da566ca5a4605', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa45bac848334cb3b27d251ce793739f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:33:15 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Creating image(s)
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "/opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "/opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "/opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "00a371a3b6100eef317a2082590c0cb2e358b94c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.171s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk 1073741824 {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c,backing_fmt=raw /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk 1073741824" returned: 0 in 0.057s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "00a371a3b6100eef317a2082590c0cb2e358b94c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/00a371a3b6100eef317a2082590c0cb2e358b94c --force-share --output=json" returned: 0 in 0.210s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk. size=1073741824 {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG nova.network.neutron [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Successfully created port: 6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG nova.virt.disk.api [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Cannot resize image /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk to a smaller size. {{(pid=74540) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Created local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Ensure instance console log exists: /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.network.neutron [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Successfully updated port: 6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquired lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.network.neutron [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-0b00ff93-6201-4f8b-890d-93c896e9c245 req-3b05a2b0-92f4-4787-b57d-4dc65d5e0f44 service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Received event network-changed-6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-0b00ff93-6201-4f8b-890d-93c896e9c245 req-3b05a2b0-92f4-4787-b57d-4dc65d5e0f44 service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Refreshing instance network info cache due to event network-changed-6764e6c7-a016-4744-b2c1-ff4867806453. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0b00ff93-6201-4f8b-890d-93c896e9c245 req-3b05a2b0-92f4-4787-b57d-4dc65d5e0f44 service nova] Acquiring lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.network.neutron [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.network.neutron [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating instance_info_cache with network_info: [{"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Releasing lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Instance network_info: |[{"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0b00ff93-6201-4f8b-890d-93c896e9c245 req-3b05a2b0-92f4-4787-b57d-4dc65d5e0f44 service nova] Acquired lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.network.neutron [req-0b00ff93-6201-4f8b-890d-93c896e9c245 req-3b05a2b0-92f4-4787-b57d-4dc65d5e0f44 service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Refreshing network info cache for port 6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Start _get_guest_xml network_info=[{"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'image_id': 'b2fc4ee2-830c-4852-b2e5-8dcdd33e1718'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:33:17 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:33:17 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-07T03:52:51Z,direct_url=<?>,disk_format='qcow2',id=b2fc4ee2-830c-4852-b2e5-8dcdd33e1718,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='85e4cd2fa8e74df0a62d09de21e82a60',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-07T03:52:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:33:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1315715253',display_name='tempest-SnapshotDataIntegrityTests-server-1315715253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1315715253',id=46,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQSOc7s57WzA+ddSzylftpiSd97FZWn7yildFc8h985H2T0wlwS3jYpAYOLZlqKa17eoSXeL//d7WoMfwlvFnOOGeMqQ9+0zcUce3giVqP/qsPg3RLiyLWpGel/uf4e7A==',key_name='tempest-keypair-1222380731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa45bac848334cb3b27d251ce793739f',ramdisk_id='',reservation_id='r-xx95rsce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1803413608',owner_user_name='tempest-SnapshotDataIntegrityTests-1803413608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:33:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55a21121d30244e98c7da566ca5a4605',uuid=36935858-ea1d-4429-99b3-695ba2c26da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Converting VIF {"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=6764e6c7-a016-4744-b2c1-ff4867806453,network=Network(293f37c8-022e-4416-ab1d-216fefec2719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764e6c7-a0') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.objects.instance [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lazy-loading 'pci_devices' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:33:17 user nova-compute[74540]:   <uuid>36935858-ea1d-4429-99b3-695ba2c26da2</uuid>
Nov 07 04:33:17 user nova-compute[74540]:   <name>instance-0000002e</name>
Nov 07 04:33:17 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:33:17 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:33:17 user nova-compute[74540]:   <metadata>
Nov 07 04:33:17 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:33:17 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:33:17 user nova-compute[74540]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1315715253</nova:name>
Nov 07 04:33:17 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:33:17</nova:creationTime>
Nov 07 04:33:17 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:33:17 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:33:17 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:33:17 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:33:17 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:33:17 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:33:17 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:33:17 user nova-compute[74540]:       <nova:owner>
Nov 07 04:33:17 user nova-compute[74540]:         <nova:user uuid="55a21121d30244e98c7da566ca5a4605">tempest-SnapshotDataIntegrityTests-1803413608-project-member</nova:user>
Nov 07 04:33:17 user nova-compute[74540]:         <nova:project uuid="aa45bac848334cb3b27d251ce793739f">tempest-SnapshotDataIntegrityTests-1803413608</nova:project>
Nov 07 04:33:17 user nova-compute[74540]:       </nova:owner>
Nov 07 04:33:17 user nova-compute[74540]:       <nova:root type="image" uuid="b2fc4ee2-830c-4852-b2e5-8dcdd33e1718"/>
Nov 07 04:33:17 user nova-compute[74540]:       <nova:ports>
Nov 07 04:33:17 user nova-compute[74540]:         <nova:port uuid="6764e6c7-a016-4744-b2c1-ff4867806453">
Nov 07 04:33:17 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 07 04:33:17 user nova-compute[74540]:         </nova:port>
Nov 07 04:33:17 user nova-compute[74540]:       </nova:ports>
Nov 07 04:33:17 user nova-compute[74540]:     </nova:instance>
Nov 07 04:33:17 user nova-compute[74540]:   </metadata>
Nov 07 04:33:17 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:33:17 user nova-compute[74540]:     <system>
Nov 07 04:33:17 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:33:17 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:33:17 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:33:17 user nova-compute[74540]:       <entry name="serial">36935858-ea1d-4429-99b3-695ba2c26da2</entry>
Nov 07 04:33:17 user nova-compute[74540]:       <entry name="uuid">36935858-ea1d-4429-99b3-695ba2c26da2</entry>
Nov 07 04:33:17 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:33:17 user nova-compute[74540]:     </system>
Nov 07 04:33:17 user nova-compute[74540]:   </sysinfo>
Nov 07 04:33:17 user nova-compute[74540]:   <os>
Nov 07 04:33:17 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:33:17 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:33:17 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:33:17 user nova-compute[74540]:   </os>
Nov 07 04:33:17 user nova-compute[74540]:   <features>
Nov 07 04:33:17 user nova-compute[74540]:     <acpi/>
Nov 07 04:33:17 user nova-compute[74540]:     <apic/>
Nov 07 04:33:17 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:33:17 user nova-compute[74540]:   </features>
Nov 07 04:33:17 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:33:17 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:33:17 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:33:17 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:33:17 user nova-compute[74540]:   </clock>
Nov 07 04:33:17 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:33:17 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:33:17 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:33:17 user nova-compute[74540]:   </cpu>
Nov 07 04:33:17 user nova-compute[74540]:   <devices>
Nov 07 04:33:17 user nova-compute[74540]:     <disk type="file" device="disk">
Nov 07 04:33:17 user nova-compute[74540]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 07 04:33:17 user nova-compute[74540]:       <source file="/opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk"/>
Nov 07 04:33:17 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:33:17 user nova-compute[74540]:     </disk>
Nov 07 04:33:17 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:33:17 user nova-compute[74540]:       <mac address="fa:16:3e:91:3a:5c"/>
Nov 07 04:33:17 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:33:17 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:33:17 user nova-compute[74540]:       <target dev="tap6764e6c7-a0"/>
Nov 07 04:33:17 user nova-compute[74540]:     </interface>
Nov 07 04:33:17 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:33:17 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/console.log" append="off"/>
Nov 07 04:33:17 user nova-compute[74540]:     </serial>
Nov 07 04:33:17 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:33:17 user nova-compute[74540]:     <video>
Nov 07 04:33:17 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:33:17 user nova-compute[74540]:     </video>
Nov 07 04:33:17 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:33:17 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:33:17 user nova-compute[74540]:     </rng>
Nov 07 04:33:17 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:33:17 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:33:17 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:33:17 user nova-compute[74540]:     </memballoon>
Nov 07 04:33:17 user nova-compute[74540]:   </devices>
Nov 07 04:33:17 user nova-compute[74540]: </domain>
Nov 07 04:33:17 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:33:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1315715253',display_name='tempest-SnapshotDataIntegrityTests-server-1315715253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1315715253',id=46,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQSOc7s57WzA+ddSzylftpiSd97FZWn7yildFc8h985H2T0wlwS3jYpAYOLZlqKa17eoSXeL//d7WoMfwlvFnOOGeMqQ9+0zcUce3giVqP/qsPg3RLiyLWpGel/uf4e7A==',key_name='tempest-keypair-1222380731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa45bac848334cb3b27d251ce793739f',ramdisk_id='',reservation_id='r-xx95rsce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1803413608',owner_user_name='tempest-SnapshotDataIntegrityTests-1803413608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:33:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55a21121d30244e98c7da566ca5a4605',uuid=36935858-ea1d-4429-99b3-695ba2c26da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Converting VIF {"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=6764e6c7-a016-4744-b2c1-ff4867806453,network=Network(293f37c8-022e-4416-ab1d-216fefec2719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764e6c7-a0') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG os_vif [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=6764e6c7-a016-4744-b2c1-ff4867806453,network=Network(293f37c8-022e-4416-ab1d-216fefec2719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764e6c7-a0') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8b867ca-dcf9-5e79-8d51-fd4bc586941e', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6764e6c7-a0, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6764e6c7-a0, col_values=(('qos', UUID('7abd64e5-0a40-45a1-bab0-e2864c453b25')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6764e6c7-a0, col_values=(('external_ids', {'iface-id': '6764e6c7-a016-4744-b2c1-ff4867806453', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:3a:5c', 'vm-uuid': '36935858-ea1d-4429-99b3-695ba2c26da2'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:17 user nova-compute[74540]: INFO os_vif [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=6764e6c7-a016-4744-b2c1-ff4867806453,network=Network(293f37c8-022e-4416-ab1d-216fefec2719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764e6c7-a0')
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:33:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] No VIF found with MAC fa:16:3e:91:3a:5c, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:33:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-0b00ff93-6201-4f8b-890d-93c896e9c245 req-3b05a2b0-92f4-4787-b57d-4dc65d5e0f44 service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updated VIF entry in instance network info cache for port 6764e6c7-a016-4744-b2c1-ff4867806453. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:33:18 user nova-compute[74540]: DEBUG nova.network.neutron [req-0b00ff93-6201-4f8b-890d-93c896e9c245 req-3b05a2b0-92f4-4787-b57d-4dc65d5e0f44 service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating instance_info_cache with network_info: [{"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:33:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0b00ff93-6201-4f8b-890d-93c896e9c245 req-3b05a2b0-92f4-4787-b57d-4dc65d5e0f44 service nova] Releasing lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:33:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-3c397684-2e38-42a7-9a9b-44d74e58a403 req-2786deae-b52d-4872-9bee-e1fdbc281a8e service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Received event network-vif-plugged-6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:33:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3c397684-2e38-42a7-9a9b-44d74e58a403 req-2786deae-b52d-4872-9bee-e1fdbc281a8e service nova] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3c397684-2e38-42a7-9a9b-44d74e58a403 req-2786deae-b52d-4872-9bee-e1fdbc281a8e service nova] Lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-3c397684-2e38-42a7-9a9b-44d74e58a403 req-2786deae-b52d-4872-9bee-e1fdbc281a8e service nova] Lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-3c397684-2e38-42a7-9a9b-44d74e58a403 req-2786deae-b52d-4872-9bee-e1fdbc281a8e service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] No waiting events found dispatching network-vif-plugged-6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:33:19 user nova-compute[74540]: WARNING nova.compute.manager [req-3c397684-2e38-42a7-9a9b-44d74e58a403 req-2786deae-b52d-4872-9bee-e1fdbc281a8e service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Received unexpected event network-vif-plugged-6764e6c7-a016-4744-b2c1-ff4867806453 for instance with vm_state building and task_state spawning.
Nov 07 04:33:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:33:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Instance spawned successfully.
Nov 07 04:33:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-e8835eb7-10ca-4bc9-b016-a4b38b8c8847 req-c7b17d58-1dc0-4234-93bf-58c2242bd21c service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Received event network-vif-plugged-6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e8835eb7-10ca-4bc9-b016-a4b38b8c8847 req-c7b17d58-1dc0-4234-93bf-58c2242bd21c service nova] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e8835eb7-10ca-4bc9-b016-a4b38b8c8847 req-c7b17d58-1dc0-4234-93bf-58c2242bd21c service nova] Lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e8835eb7-10ca-4bc9-b016-a4b38b8c8847 req-c7b17d58-1dc0-4234-93bf-58c2242bd21c service nova] Lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-e8835eb7-10ca-4bc9-b016-a4b38b8c8847 req-c7b17d58-1dc0-4234-93bf-58c2242bd21c service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] No waiting events found dispatching network-vif-plugged-6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:33:21 user nova-compute[74540]: WARNING nova.compute.manager [req-e8835eb7-10ca-4bc9-b016-a4b38b8c8847 req-c7b17d58-1dc0-4234-93bf-58c2242bd21c service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Received unexpected event network-vif-plugged-6764e6c7-a016-4744-b2c1-ff4867806453 for instance with vm_state building and task_state spawning.
Nov 07 04:33:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:33:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:21 user nova-compute[74540]: INFO nova.compute.manager [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 07 04:33:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:33:21 user nova-compute[74540]: INFO nova.compute.manager [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Took 6.58 seconds to build instance.
Nov 07 04:33:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-007084b2-412d-4554-b617-d9e039ad9f33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.785s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:33:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:33:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:33:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:33:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdJzcwFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:33:38 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:33:38 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:33:38 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ff4ac2-ab48-4a6b-a964-b43b4a39f7d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:33:38 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bfa974-45b0-4fc5-96d8-2761df4086f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061] added
Nov 07 04:33:38 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc8c76f-c435-4023-a4f5-c7ac64405f73]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[439b5e02-fca7-4e01-a685-aa5866a0db01]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mdJzcwFL {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mdJzcwFL" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dbe898-a748-4682-a705-2428ee532385]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mdJzcwFL'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cd82d7-2f4f-4f96-a20a-414e5b7c8dde]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc3356-7513-42e6-8139-a8e6b182f25a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:33:38 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:33:38 user nova-compute[74540]:  {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:33:38 user nova-compute[74540]: WARNING os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 04:33:38 user nova-compute[74540]: 
Nov 07 04:33:38 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --login" returned: 0 in 1.047s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45ba83c-def4-47a2-a427-c011e5d7861c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061, portal: 172.16.0.220,3260]
Nov 07 04:33:39 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061, portal: 172.16.0.220,3260] successful.
Nov 07 04:33:39 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a3a60b-f8da-44b9-aae0-bc03dbbc58c4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35c5a7c-a7c5-49c7-969e-a10cf90155a5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 (non-flash)
Nov 07 04:33:39 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 (non-flash)
Nov 07 04:33:39 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.248s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08ec520-6c9e-4880-a4c8-e571f8098987]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:33:39 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdJzcwFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:33:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.281s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:33:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] <== connect_volume: return (2283ms) {'type': 'block', 'scsi_wwn': '26465613837626636', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:33:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465613837626636', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:33:40 user nova-compute[74540]: DEBUG nova.objects.instance [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'flavor' on Instance uuid 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:33:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:33:40 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:33:40 user nova-compute[74540]:   <source dev="/dev/sdb"/>
Nov 07 04:33:40 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:33:40 user nova-compute[74540]:   <serial>c6a1d559-0670-44c7-b634-70a6a177a061</serial>
Nov 07 04:33:40 user nova-compute[74540]: </disk>
Nov 07 04:33:40 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:33:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:33:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:33:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] No VIF found with MAC fa:16:3e:b4:73:c2, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:33:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-377a9e2e-9a00-47dc-8110-970647fe8233 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.998s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.928s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-fb32fbff-913f-4b10-9295-cc6f87f2dec3 req-05bbb4c2-87af-47d1-8940-585b48aaa51e service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-changed-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:33:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-fb32fbff-913f-4b10-9295-cc6f87f2dec3 req-05bbb4c2-87af-47d1-8940-585b48aaa51e service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Refreshing instance network info cache due to event network-changed-ab82e983-c662-4173-a423-00d4c5fb77f2. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:33:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fb32fbff-913f-4b10-9295-cc6f87f2dec3 req-05bbb4c2-87af-47d1-8940-585b48aaa51e service nova] Acquiring lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:33:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fb32fbff-913f-4b10-9295-cc6f87f2dec3 req-05bbb4c2-87af-47d1-8940-585b48aaa51e service nova] Acquired lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:33:44 user nova-compute[74540]: DEBUG nova.network.neutron [req-fb32fbff-913f-4b10-9295-cc6f87f2dec3 req-05bbb4c2-87af-47d1-8940-585b48aaa51e service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Refreshing network info cache for port ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:33:44 user nova-compute[74540]: DEBUG nova.network.neutron [req-fb32fbff-913f-4b10-9295-cc6f87f2dec3 req-05bbb4c2-87af-47d1-8940-585b48aaa51e service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updated VIF entry in instance network info cache for port ab82e983-c662-4173-a423-00d4c5fb77f2. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:33:44 user nova-compute[74540]: DEBUG nova.network.neutron [req-fb32fbff-913f-4b10-9295-cc6f87f2dec3 req-05bbb4c2-87af-47d1-8940-585b48aaa51e service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updating instance_info_cache with network_info: [{"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:33:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fb32fbff-913f-4b10-9295-cc6f87f2dec3 req-05bbb4c2-87af-47d1-8940-585b48aaa51e service nova] Releasing lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:33:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-e879d662-9fa6-45f6-a492-32d12d4c00d4 req-7cca2e3b-6d68-45fd-8246-7e45d1b96617 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-changed-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:33:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-e879d662-9fa6-45f6-a492-32d12d4c00d4 req-7cca2e3b-6d68-45fd-8246-7e45d1b96617 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Refreshing instance network info cache due to event network-changed-ab82e983-c662-4173-a423-00d4c5fb77f2. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:33:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e879d662-9fa6-45f6-a492-32d12d4c00d4 req-7cca2e3b-6d68-45fd-8246-7e45d1b96617 service nova] Acquiring lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:33:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e879d662-9fa6-45f6-a492-32d12d4c00d4 req-7cca2e3b-6d68-45fd-8246-7e45d1b96617 service nova] Acquired lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:33:46 user nova-compute[74540]: DEBUG nova.network.neutron [req-e879d662-9fa6-45f6-a492-32d12d4c00d4 req-7cca2e3b-6d68-45fd-8246-7e45d1b96617 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Refreshing network info cache for port ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:33:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:47 user nova-compute[74540]: INFO nova.compute.manager [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Rebooting instance
Nov 07 04:33:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:33:47 user nova-compute[74540]: DEBUG nova.network.neutron [req-e879d662-9fa6-45f6-a492-32d12d4c00d4 req-7cca2e3b-6d68-45fd-8246-7e45d1b96617 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updated VIF entry in instance network info cache for port ab82e983-c662-4173-a423-00d4c5fb77f2. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:33:47 user nova-compute[74540]: DEBUG nova.network.neutron [req-e879d662-9fa6-45f6-a492-32d12d4c00d4 req-7cca2e3b-6d68-45fd-8246-7e45d1b96617 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updating instance_info_cache with network_info: [{"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:33:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e879d662-9fa6-45f6-a492-32d12d4c00d4 req-7cca2e3b-6d68-45fd-8246-7e45d1b96617 service nova] Releasing lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:33:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquired lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:33:47 user nova-compute[74540]: DEBUG nova.network.neutron [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:33:47 user nova-compute[74540]: DEBUG nova.network.neutron [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updating instance_info_cache with network_info: [{"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:33:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Releasing lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:33:47 user nova-compute[74540]: DEBUG nova.compute.manager [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:33:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-eb8dad1a-c95c-4dda-ad71-0da1d84ea0ab req-b2640ccf-d7fd-47e3-b428-d459c7bcd86e service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-vif-unplugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:33:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-eb8dad1a-c95c-4dda-ad71-0da1d84ea0ab req-b2640ccf-d7fd-47e3-b428-d459c7bcd86e service nova] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-eb8dad1a-c95c-4dda-ad71-0da1d84ea0ab req-b2640ccf-d7fd-47e3-b428-d459c7bcd86e service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-eb8dad1a-c95c-4dda-ad71-0da1d84ea0ab req-b2640ccf-d7fd-47e3-b428-d459c7bcd86e service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-eb8dad1a-c95c-4dda-ad71-0da1d84ea0ab req-b2640ccf-d7fd-47e3-b428-d459c7bcd86e service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] No waiting events found dispatching network-vif-unplugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:33:50 user nova-compute[74540]: WARNING nova.compute.manager [req-eb8dad1a-c95c-4dda-ad71-0da1d84ea0ab req-b2640ccf-d7fd-47e3-b428-d459c7bcd86e service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received unexpected event network-vif-unplugged-ab82e983-c662-4173-a423-00d4c5fb77f2 for instance with vm_state active and task_state reboot_started.
Nov 07 04:33:51 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Instance shutdown successfully.
Nov 07 04:33:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-fdb1b1d3-f11d-4504-b84f-699ab0866fab req-8886c4af-9b85-4b85-9ca4-3c67df855e61 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:33:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fdb1b1d3-f11d-4504-b84f-699ab0866fab req-8886c4af-9b85-4b85-9ca4-3c67df855e61 service nova] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fdb1b1d3-f11d-4504-b84f-699ab0866fab req-8886c4af-9b85-4b85-9ca4-3c67df855e61 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-fdb1b1d3-f11d-4504-b84f-699ab0866fab req-8886c4af-9b85-4b85-9ca4-3c67df855e61 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-fdb1b1d3-f11d-4504-b84f-699ab0866fab req-8886c4af-9b85-4b85-9ca4-3c67df855e61 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] No waiting events found dispatching network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:33:52 user nova-compute[74540]: WARNING nova.compute.manager [req-fdb1b1d3-f11d-4504-b84f-699ab0866fab req-8886c4af-9b85-4b85-9ca4-3c67df855e61 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received unexpected event network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 for instance with vm_state active and task_state reboot_started.
Nov 07 04:33:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Instance running successfully.
Nov 07 04:33:54 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Instance soft rebooted successfully.
Nov 07 04:33:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:33:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-5c3e999c-9c1a-4688-9d1c-72d0117a795d req-d1aa4deb-98d5-4886-b60e-6957450d0237 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:33:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5c3e999c-9c1a-4688-9d1c-72d0117a795d req-d1aa4deb-98d5-4886-b60e-6957450d0237 service nova] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5c3e999c-9c1a-4688-9d1c-72d0117a795d req-d1aa4deb-98d5-4886-b60e-6957450d0237 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5c3e999c-9c1a-4688-9d1c-72d0117a795d req-d1aa4deb-98d5-4886-b60e-6957450d0237 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-5c3e999c-9c1a-4688-9d1c-72d0117a795d req-d1aa4deb-98d5-4886-b60e-6957450d0237 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] No waiting events found dispatching network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:33:54 user nova-compute[74540]: WARNING nova.compute.manager [req-5c3e999c-9c1a-4688-9d1c-72d0117a795d req-d1aa4deb-98d5-4886-b60e-6957450d0237 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received unexpected event network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 for instance with vm_state active and task_state reboot_started.
Nov 07 04:33:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-5c3e999c-9c1a-4688-9d1c-72d0117a795d req-d1aa4deb-98d5-4886-b60e-6957450d0237 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:33:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5c3e999c-9c1a-4688-9d1c-72d0117a795d req-d1aa4deb-98d5-4886-b60e-6957450d0237 service nova] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:33:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5c3e999c-9c1a-4688-9d1c-72d0117a795d req-d1aa4deb-98d5-4886-b60e-6957450d0237 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:33:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5c3e999c-9c1a-4688-9d1c-72d0117a795d req-d1aa4deb-98d5-4886-b60e-6957450d0237 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-5c3e999c-9c1a-4688-9d1c-72d0117a795d req-d1aa4deb-98d5-4886-b60e-6957450d0237 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] No waiting events found dispatching network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:33:54 user nova-compute[74540]: WARNING nova.compute.manager [req-5c3e999c-9c1a-4688-9d1c-72d0117a795d req-d1aa4deb-98d5-4886-b60e-6957450d0237 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received unexpected event network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 for instance with vm_state active and task_state reboot_started.
Nov 07 04:33:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-2533cb34-f571-4dad-9128-72a1749a9aeb tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.387s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:33:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:33:58 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:33:58 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:33:58 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:33:59 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:33:59 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:34:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:34:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:34:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:34:08 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:34:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:34:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:34:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 04:34:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:34:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:34:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:34:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:34:11 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:34:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:34:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:34:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:34:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:34:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:34:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:34:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:34:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:34:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:34:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:13 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:34:13 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:34:13 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8699MB free_disk=24.769580841064453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:34:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:34:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:34:13 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:34:13 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 36935858-ea1d-4429-99b3-695ba2c26da2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:34:13 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:34:13 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:34:13 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:34:13 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:34:13 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:34:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:34:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:34:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:34:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:34:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:34:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:34:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:34:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:34:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:00 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:35:00 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:35:00 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:35:00 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:35:00 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:35:00 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:35:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:35:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:35:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-c623d270-5ef7-4190-af42-264d35af6305 req-b65b86ab-072c-4131-882d-86a53d1102e2 service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Received event network-changed-6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:35:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-c623d270-5ef7-4190-af42-264d35af6305 req-b65b86ab-072c-4131-882d-86a53d1102e2 service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Refreshing instance network info cache due to event network-changed-6764e6c7-a016-4744-b2c1-ff4867806453. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:35:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c623d270-5ef7-4190-af42-264d35af6305 req-b65b86ab-072c-4131-882d-86a53d1102e2 service nova] Acquiring lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:35:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c623d270-5ef7-4190-af42-264d35af6305 req-b65b86ab-072c-4131-882d-86a53d1102e2 service nova] Acquired lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:35:06 user nova-compute[74540]: DEBUG nova.network.neutron [req-c623d270-5ef7-4190-af42-264d35af6305 req-b65b86ab-072c-4131-882d-86a53d1102e2 service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Refreshing network info cache for port 6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:35:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:06 user nova-compute[74540]: DEBUG nova.network.neutron [req-c623d270-5ef7-4190-af42-264d35af6305 req-b65b86ab-072c-4131-882d-86a53d1102e2 service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updated VIF entry in instance network info cache for port 6764e6c7-a016-4744-b2c1-ff4867806453. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:35:06 user nova-compute[74540]: DEBUG nova.network.neutron [req-c623d270-5ef7-4190-af42-264d35af6305 req-b65b86ab-072c-4131-882d-86a53d1102e2 service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating instance_info_cache with network_info: [{"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:35:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c623d270-5ef7-4190-af42-264d35af6305 req-b65b86ab-072c-4131-882d-86a53d1102e2 service nova] Releasing lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:35:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:08 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:35:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:35:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:35:12 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:35:12 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lazy-loading 'flavor' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:35:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:35:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:35:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:35:12 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:35:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:35:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:12 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:35:13 user nova-compute[74540]: INFO nova.compute.manager [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Attaching volume 8403df05-f766-4cf3-b844-1dbdba6fb97d to /dev/vdb
Nov 07 04:35:13 user nova-compute[74540]: DEBUG os_brick.utils [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c842c08b-2251-481b-baef-6fbd995631b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a32d3f7-ee25-40b6-9349-0e10f3477920]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad53beda-e6a7-479d-891e-1225ce7d647c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[21709cce-a26e-44ac-9ada-602bb0ca4339]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:35:13 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1963c516-a591-42d4-967f-0eae5c1bbb76]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG os_brick.utils [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating existing volume attachment record: e0f7434d-86c5-48e2-adb2-fcb64ea2d180 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:35:14 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:35:14 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:35:14 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=24.76052474975586GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:35:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:35:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:35:14 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:35:14 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 36935858-ea1d-4429-99b3-695ba2c26da2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:35:14 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:35:14 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:35:14 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:35:14 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:35:14 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:35:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:35:15 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:35:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:35:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:35:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:35:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:35:15 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:35:15 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:35:15 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updating instance_info_cache with network_info: [{"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:35:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:35:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:35:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heWZTzcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:35:33 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:35:33 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:35:33 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7565ae-1a87-46d7-b08c-d1c796b2e2aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:35:33 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac3f8e7-df90-44b6-87e5-e72cbc2f0343]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d] added
Nov 07 04:35:33 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d04ed3e-1551-41cb-adb3-7e7251f30b50]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[378b9fe3-c314-499e-b4dc-a3d3d4e3e8e4]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heWZTzcn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heWZTzcn" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[54251bd9-4ec8-4d52-baa9-40fbab86e2fe]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'heWZTzcn'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[578c8c38-4cd2-4f62-9473-01bb96cf9207]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a9e1c3-96ff-4e6a-939a-45d4100d6a25]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 (non-flash)
Nov 07 04:35:33 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 (non-flash)
Nov 07 04:35:33 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[144f87e3-41fe-4f5b-b868-26cf9b154898]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d, portal: 172.16.0.220,3260]
Nov 07 04:35:33 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d, portal: 172.16.0.220,3260] successful.
Nov 07 04:35:33 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e24e58-6046-4232-a7b5-79a2c76fed7f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:35:33 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[78494791-3926-45d8-a548-7721132f6c20]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 (non-flash)
Nov 07 04:35:34 user nova-compute[74540]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d (non-flash)
Nov 07 04:35:34 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 (non-flash)
Nov 07 04:35:34 user nova-compute[74540]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d (non-flash)
Nov 07 04:35:34 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[05aea595-21e6-45b3-95fd-162551c1c8d9]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:35:34 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heWZTzcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:35:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:35:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23465393938303532', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:35:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465393938303532', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:35:35 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lazy-loading 'flavor' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:35:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:35:35 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:35:35 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:35:35 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:35:35 user nova-compute[74540]:   <serial>8403df05-f766-4cf3-b844-1dbdba6fb97d</serial>
Nov 07 04:35:35 user nova-compute[74540]: </disk>
Nov 07 04:35:35 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:35:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:35:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:35:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] No VIF found with MAC fa:16:3e:91:3a:5c, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:35:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7a1cdd61-bb09-4850-94f4-ceceddf424b1 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.624s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:35:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-45f8532d-bac4-4838-84c5-4d7b79512847 req-07946f7c-15f3-4551-ae42-778db632ff06 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-changed-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:35:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-45f8532d-bac4-4838-84c5-4d7b79512847 req-07946f7c-15f3-4551-ae42-778db632ff06 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Refreshing instance network info cache due to event network-changed-ab82e983-c662-4173-a423-00d4c5fb77f2. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:35:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-45f8532d-bac4-4838-84c5-4d7b79512847 req-07946f7c-15f3-4551-ae42-778db632ff06 service nova] Acquiring lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:35:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-45f8532d-bac4-4838-84c5-4d7b79512847 req-07946f7c-15f3-4551-ae42-778db632ff06 service nova] Acquired lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:35:39 user nova-compute[74540]: DEBUG nova.network.neutron [req-45f8532d-bac4-4838-84c5-4d7b79512847 req-07946f7c-15f3-4551-ae42-778db632ff06 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Refreshing network info cache for port ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:35:39 user nova-compute[74540]: DEBUG nova.network.neutron [req-45f8532d-bac4-4838-84c5-4d7b79512847 req-07946f7c-15f3-4551-ae42-778db632ff06 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updated VIF entry in instance network info cache for port ab82e983-c662-4173-a423-00d4c5fb77f2. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:35:39 user nova-compute[74540]: DEBUG nova.network.neutron [req-45f8532d-bac4-4838-84c5-4d7b79512847 req-07946f7c-15f3-4551-ae42-778db632ff06 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updating instance_info_cache with network_info: [{"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:35:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-45f8532d-bac4-4838-84c5-4d7b79512847 req-07946f7c-15f3-4551-ae42-778db632ff06 service nova] Releasing lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-7a531083-efbb-4aa1-a61c-7c9a9148e570 req-84adedd6-7ae2-4310-b004-68acd40c537d service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-changed-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG nova.compute.manager [req-7a531083-efbb-4aa1-a61c-7c9a9148e570 req-84adedd6-7ae2-4310-b004-68acd40c537d service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Refreshing instance network info cache due to event network-changed-ab82e983-c662-4173-a423-00d4c5fb77f2. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7a531083-efbb-4aa1-a61c-7c9a9148e570 req-84adedd6-7ae2-4310-b004-68acd40c537d service nova] Acquiring lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7a531083-efbb-4aa1-a61c-7c9a9148e570 req-84adedd6-7ae2-4310-b004-68acd40c537d service nova] Acquired lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG nova.network.neutron [req-7a531083-efbb-4aa1-a61c-7c9a9148e570 req-84adedd6-7ae2-4310-b004-68acd40c537d service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Refreshing network info cache for port ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:35:40 user nova-compute[74540]: INFO nova.compute.manager [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Detaching volume c6a1d559-0670-44c7-b634-70a6a177a061
Nov 07 04:35:40 user nova-compute[74540]: INFO nova.virt.block_device [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Attempting to driver detach volume c6a1d559-0670-44c7-b634-70a6a177a061 from mountpoint /dev/vdb
Nov 07 04:35:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Attempting to detach device vdb from instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:35:40 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:35:40 user nova-compute[74540]:   <source dev="/dev/sdb"/>
Nov 07 04:35:40 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:35:40 user nova-compute[74540]:   <serial>c6a1d559-0670-44c7-b634-70a6a177a061</serial>
Nov 07 04:35:40 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:35:40 user nova-compute[74540]: </disk>
Nov 07 04:35:40 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:35:40 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Successfully detached device vdb from instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 from the persistent domain config.
Nov 07 04:35:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:35:40 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:35:40 user nova-compute[74540]:   <source dev="/dev/sdb"/>
Nov 07 04:35:40 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:35:40 user nova-compute[74540]:   <serial>c6a1d559-0670-44c7-b634-70a6a177a061</serial>
Nov 07 04:35:40 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:35:40 user nova-compute[74540]: </disk>
Nov 07 04:35:40 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG nova.network.neutron [req-7a531083-efbb-4aa1-a61c-7c9a9148e570 req-84adedd6-7ae2-4310-b004-68acd40c537d service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updated VIF entry in instance network info cache for port ab82e983-c662-4173-a423-00d4c5fb77f2. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG nova.network.neutron [req-7a531083-efbb-4aa1-a61c-7c9a9148e570 req-84adedd6-7ae2-4310-b004-68acd40c537d service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updating instance_info_cache with network_info: [{"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:35:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7a531083-efbb-4aa1-a61c-7c9a9148e570 req-84adedd6-7ae2-4310-b004-68acd40c537d service nova] Releasing lock "refresh_cache-94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:35:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:35:59 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:36:00 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 is timed out.
Nov 07 04:36:00 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Successfully detached device vdb from instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 from the live domain config.
Nov 07 04:36:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mdJzcwFL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:36:00 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[df643e0c-4588-4607-8c77-844528d2c25a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:36:00 user nova-compute[74540]: No targets found.
Nov 07 04:36:00 user nova-compute[74540]: iSNS:
Nov 07 04:36:00 user nova-compute[74540]: No targets found.
Nov 07 04:36:00 user nova-compute[74540]: STATIC:
Nov 07 04:36:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061
Nov 07 04:36:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:36:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:36:00 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d
Nov 07 04:36:00 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:36:00 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:36:00 user nova-compute[74540]: FIRMWARE:
Nov 07 04:36:00 user nova-compute[74540]: No targets found.
Nov 07 04:36:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:36:00 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:36:00 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c926ce9-4da4-408c-8a60-c59a58005e49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b358cce-8eba-42a2-a51d-07c8229f4041]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 (non-flash)
Nov 07 04:36:00 user nova-compute[74540]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d (non-flash)
Nov 07 04:36:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 (non-flash)
Nov 07 04:36:00 user nova-compute[74540]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d (non-flash)
Nov 07 04:36:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee14125c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[38902e89-499f-4e5c-b900-068b238bfe6e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[990795ef-9d3c-415d-89ab-e477c77ff8b5]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ecac0f-f978-429f-9223-6f2461e42ccf]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e64dc41-01ca-482d-a43b-14346e40fbc6]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c568df-247b-4475-9c58-62e99fa3d481]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[13093ca3-f43a-4a75-bf81-96ac6b362eb2]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061, portal: 172.16.0.220,3260]
Nov 07 04:36:00 user nova-compute[74540]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061, portal: 172.16.0.220,3260] successful.
Nov 07 04:36:00 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6a1d559-0670-44c7-b634-70a6a177a061 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[61aee1f1-a997-4e30-b413-63073ca4f6d5]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] <== disconnect_volume: return (280ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:36:00 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:36:01 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:36:01 user nova-compute[74540]: DEBUG nova.objects.instance [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'flavor' on Instance uuid 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:36:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-09b3fc78-08ed-488b-bc9b-496515e44522 tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.709s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:36:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:36:02 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:36:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:36:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:06 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:36:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:09 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:36:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:36:13 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:36:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:36:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:36:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:36:13 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:36:14 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating instance_info_cache with network_info: [{"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:36:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:36:14 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:36:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:36:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:36:14 user nova-compute[74540]: INFO nova.compute.manager [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Detaching volume 8403df05-f766-4cf3-b844-1dbdba6fb97d
Nov 07 04:36:14 user nova-compute[74540]: INFO nova.virt.block_device [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Attempting to driver detach volume 8403df05-f766-4cf3-b844-1dbdba6fb97d from mountpoint /dev/vdb
Nov 07 04:36:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Attempting to detach device vdb from instance 36935858-ea1d-4429-99b3-695ba2c26da2 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:36:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:36:14 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:36:14 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:36:14 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:36:14 user nova-compute[74540]:   <serial>8403df05-f766-4cf3-b844-1dbdba6fb97d</serial>
Nov 07 04:36:14 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:36:14 user nova-compute[74540]: </disk>
Nov 07 04:36:14 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:36:14 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Successfully detached device vdb from instance 36935858-ea1d-4429-99b3-695ba2c26da2 from the persistent domain config.
Nov 07 04:36:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 36935858-ea1d-4429-99b3-695ba2c26da2 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:36:14 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:36:14 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:36:14 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:36:14 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:36:14 user nova-compute[74540]:   <serial>8403df05-f766-4cf3-b844-1dbdba6fb97d</serial>
Nov 07 04:36:14 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:36:14 user nova-compute[74540]: </disk>
Nov 07 04:36:14 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:36:14 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:36:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:36:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:36:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:36:14 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:36:15 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:36:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:16 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:36:16 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:36:16 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8845MB free_disk=24.75896453857422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:36:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:36:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:36:16 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:36:16 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 36935858-ea1d-4429-99b3-695ba2c26da2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:36:16 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:36:16 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:36:16 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:36:16 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:36:16 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:36:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:36:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:35 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 36935858-ea1d-4429-99b3-695ba2c26da2 is timed out.
Nov 07 04:36:35 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Successfully detached device vdb from instance 36935858-ea1d-4429-99b3-695ba2c26da2 from the live domain config.
Nov 07 04:36:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heWZTzcn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:36:35 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed3d25a-f07a-4162-8276-f241fc999d2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:36:35 user nova-compute[74540]: No targets found.
Nov 07 04:36:35 user nova-compute[74540]: iSNS:
Nov 07 04:36:35 user nova-compute[74540]: No targets found.
Nov 07 04:36:35 user nova-compute[74540]: STATIC:
Nov 07 04:36:35 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d
Nov 07 04:36:35 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:36:35 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:36:35 user nova-compute[74540]: FIRMWARE:
Nov 07 04:36:35 user nova-compute[74540]: No targets found.
Nov 07 04:36:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:36:35 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:36:35 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cbaecb-81e3-4afa-a23c-acb8d14457c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b805ef06-12df-47eb-8c78-81546307c0bc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d (non-flash)
Nov 07 04:36:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d (non-flash)
Nov 07 04:36:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc38fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[394e315e-a003-4cf5-ad93-9142319a8c73]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ee2087-5cba-403d-afef-bf1be91cf4be]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ba7923-7696-48ac-8bf4-b69e5e3b712d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9713eea2-f7cc-4b83-937f-bb762dd929c9]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9506b92e-880f-4178-bdb6-ec5b716008f9]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a604501a-3492-4e57-9ecc-e6d32b71b471]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d, portal: 172.16.0.220,3260]
Nov 07 04:36:35 user nova-compute[74540]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d, portal: 172.16.0.220,3260] successful.
Nov 07 04:36:35 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8403df05-f766-4cf3-b844-1dbdba6fb97d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c66a7ac-2778-4b8d-847c-799b95daa471]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] <== disconnect_volume: return (285ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:36:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:36:36 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lazy-loading 'flavor' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:36:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f2e034fc-406f-4717-9e1f-053f6cca8a35 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.746s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:36:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:36:41 user nova-compute[74540]: INFO nova.compute.manager [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Terminating instance
Nov 07 04:36:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-260a7873-2f21-4fb8-a48e-0c4b593a19b4 req-acbca9c0-b84c-4e5d-8c94-f12ee2210315 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-vif-unplugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-260a7873-2f21-4fb8-a48e-0c4b593a19b4 req-acbca9c0-b84c-4e5d-8c94-f12ee2210315 service nova] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-260a7873-2f21-4fb8-a48e-0c4b593a19b4 req-acbca9c0-b84c-4e5d-8c94-f12ee2210315 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-260a7873-2f21-4fb8-a48e-0c4b593a19b4 req-acbca9c0-b84c-4e5d-8c94-f12ee2210315 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-260a7873-2f21-4fb8-a48e-0c4b593a19b4 req-acbca9c0-b84c-4e5d-8c94-f12ee2210315 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] No waiting events found dispatching network-vif-unplugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-260a7873-2f21-4fb8-a48e-0c4b593a19b4 req-acbca9c0-b84c-4e5d-8c94-f12ee2210315 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-vif-unplugged-ab82e983-c662-4173-a423-00d4c5fb77f2 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:36:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Instance destroyed successfully.
Nov 07 04:36:42 user nova-compute[74540]: DEBUG nova.objects.instance [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lazy-loading 'resources' on Instance uuid 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-905414929',display_name='tempest-TestMinimumBasicScenario-server-905414929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-905414929',id=45,image_ref='37c4dd9c-00ef-4628-a52b-08bbc83729ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlqAZrGHBDkVsJ4Cvb3L4YkeBkBrH6zGqmA61h2smVD++I5kBA1mBJhJVWaI9IkrFHu/M9hsEF0DD9bmgdXWOilayw1/qwTYYgzM+9/W92rHSr7BsCuldxbn27uvSJJPg==',key_name='tempest-TestMinimumBasicScenario-1047564483',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:31:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92bc5f60b66347ca8404e1553ec719d7',ramdisk_id='',reservation_id='r-0pcy97q3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='37c4dd9c-00ef-4628-a52b-08bbc83729ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-702707071',owner_user_name='tempest-TestMinimumBasicScenario-702707071-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:33:54Z,user_data=None,user_id='48997d7730cb406dbf7d127224a52543',uuid=94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converting VIF {"id": "ab82e983-c662-4173-a423-00d4c5fb77f2", "address": "fa:16:3e:b4:73:c2", "network": {"id": "2de8c692-cb98-4106-8aab-04349918ed81", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-359929363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc5f60b66347ca8404e1553ec719d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab82e983-c6", "ovs_interfaceid": "ab82e983-c662-4173-a423-00d4c5fb77f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:73:c2,bridge_name='br-int',has_traffic_filtering=True,id=ab82e983-c662-4173-a423-00d4c5fb77f2,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab82e983-c6') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG os_vif [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:73:c2,bridge_name='br-int',has_traffic_filtering=True,id=ab82e983-c662-4173-a423-00d4c5fb77f2,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab82e983-c6') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab82e983-c6, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1808455-e3bb-413b-94ef-801404dbd085) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:36:42 user nova-compute[74540]: INFO os_vif [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:73:c2,bridge_name='br-int',has_traffic_filtering=True,id=ab82e983-c662-4173-a423-00d4c5fb77f2,network=Network(2de8c692-cb98-4106-8aab-04349918ed81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab82e983-c6')
Nov 07 04:36:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Deleting instance files /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4_del
Nov 07 04:36:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Deletion of /opt/stack/data/nova/instances/94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4_del complete
Nov 07 04:36:42 user nova-compute[74540]: INFO nova.compute.manager [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 07 04:36:42 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:36:42 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Took 0.44 seconds to deallocate network for instance.
Nov 07 04:36:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:36:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:36:42 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Deleted allocations for instance 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4
Nov 07 04:36:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-91622734-c461-43ae-ab04-8bb991a71dda tempest-TestMinimumBasicScenario-702707071 tempest-TestMinimumBasicScenario-702707071-project-member] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.703s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:36:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-271e2260-f356-46ef-a60d-36b2d0945701 req-87ba75a9-1dab-444c-8d37-8635bad291e6 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:36:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-271e2260-f356-46ef-a60d-36b2d0945701 req-87ba75a9-1dab-444c-8d37-8635bad291e6 service nova] Acquiring lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:36:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-271e2260-f356-46ef-a60d-36b2d0945701 req-87ba75a9-1dab-444c-8d37-8635bad291e6 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:36:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-271e2260-f356-46ef-a60d-36b2d0945701 req-87ba75a9-1dab-444c-8d37-8635bad291e6 service nova] Lock "94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:36:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-271e2260-f356-46ef-a60d-36b2d0945701 req-87ba75a9-1dab-444c-8d37-8635bad291e6 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] No waiting events found dispatching network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:36:43 user nova-compute[74540]: WARNING nova.compute.manager [req-271e2260-f356-46ef-a60d-36b2d0945701 req-87ba75a9-1dab-444c-8d37-8635bad291e6 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received unexpected event network-vif-plugged-ab82e983-c662-4173-a423-00d4c5fb77f2 for instance with vm_state deleted and task_state None.
Nov 07 04:36:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-271e2260-f356-46ef-a60d-36b2d0945701 req-87ba75a9-1dab-444c-8d37-8635bad291e6 service nova] [instance: 94f008aa-ecfa-40eb-ae6c-eb8d5b3809c4] Received event network-vif-deleted-ab82e983-c662-4173-a423-00d4c5fb77f2 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:36:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:36:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:36:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:36:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:36:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:36:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:37:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:37:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:37:03 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:37:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:37:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:37:04 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:37:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:37:07 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:37:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:37:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:37:10 user nova-compute[74540]: DEBUG nova.objects.instance [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lazy-loading 'flavor' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:37:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:37:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:37:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:37:10 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:37:10 user nova-compute[74540]: INFO nova.compute.manager [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Attaching volume 98dfd053-3420-4c86-b82e-536c77178c9e to /dev/vdb
Nov 07 04:37:11 user nova-compute[74540]: DEBUG os_brick.utils [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f7d3ec-9e4a-441f-accc-6125c99dd3a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fd26a9-4fa4-4735-aa3c-8c05356ef48b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f171c400-6a3c-4342-97b7-330bddf2bd8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c008cc11-ff1a-4233-a298-3e1b9e76096d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:37:11 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:37:11 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d9e9d7-7da6-4cd7-bd82-ac6859e245b7]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG os_brick.utils [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating existing volume attachment record: 6d700e46-0147-4910-abe8-a65071ac60ad {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:37:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:14 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:37:14 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:37:14 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:37:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:37:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:37:14 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:37:14 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:37:15 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating instance_info_cache with network_info: [{"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:37:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:37:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:37:15 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:37:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:37:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:37:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:37:15 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:37:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:16 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:37:16 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:37:16 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8938MB free_disk=24.78597640991211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:37:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:37:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:37:16 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 36935858-ea1d-4429-99b3-695ba2c26da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:37:16 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:37:16 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:37:16 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:37:16 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:37:16 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:37:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:37:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:37:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:37:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:37:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:37:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSUJRfIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:37:31 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:37:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:37:31 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:37:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:37:31 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:37:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fc4a2b-516c-4c24-a3f5-45462f02a6a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:37:31 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c1bd78-df4e-4354-90fe-81373b766447]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e] added
Nov 07 04:37:31 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac8332d-7fdb-4e4b-91d2-13229bf222eb]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:37:31 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3124c7ac-0e6f-423c-9c8d-653a0ef90393]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CSUJRfIW {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CSUJRfIW" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5b9dc1-9436-4386-9e56-ca46f725a901]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CSUJRfIW'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccd0a0c-bf8e-4837-8a72-d4aac453b882]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9215727a-fbdc-4308-9fab-f55fcd8df88e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:37:32 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:37:32 user nova-compute[74540]:  {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:37:32 user nova-compute[74540]: WARNING os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 04:37:32 user nova-compute[74540]: 
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ca9094-f749-4313-9105-35ff847bfafd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e, portal: 172.16.0.220,3260]
Nov 07 04:37:32 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e, portal: 172.16.0.220,3260] successful.
Nov 07 04:37:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[589315b3-bdfc-48c0-86f3-f12a2364971a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de69843-152d-4240-95b3-900e4755fd2f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e (non-flash)
Nov 07 04:37:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e (non-flash)
Nov 07 04:37:32 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[27958ec8-9743-4eb3-a37f-cfb6486e9bef]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:37:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:33 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:37:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSUJRfIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:37:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:37:33 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23333303262353631', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:37:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333303262353631', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:37:33 user nova-compute[74540]: DEBUG nova.objects.instance [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lazy-loading 'flavor' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:37:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:37:33 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:37:33 user nova-compute[74540]:   <source dev="/dev/sdb"/>
Nov 07 04:37:33 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:37:33 user nova-compute[74540]:   <serial>98dfd053-3420-4c86-b82e-536c77178c9e</serial>
Nov 07 04:37:33 user nova-compute[74540]: </disk>
Nov 07 04:37:33 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:37:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:37:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:37:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] No VIF found with MAC fa:16:3e:91:3a:5c, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:37:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a21add06-ecf9-413a-8acb-2875e5a4ba22 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.773s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:37:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:37:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:37:36 user nova-compute[74540]: INFO nova.compute.manager [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Detaching volume 98dfd053-3420-4c86-b82e-536c77178c9e
Nov 07 04:37:36 user nova-compute[74540]: INFO nova.virt.block_device [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Attempting to driver detach volume 98dfd053-3420-4c86-b82e-536c77178c9e from mountpoint /dev/vdb
Nov 07 04:37:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Attempting to detach device vdb from instance 36935858-ea1d-4429-99b3-695ba2c26da2 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:37:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:37:36 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:37:36 user nova-compute[74540]:   <source dev="/dev/sdb"/>
Nov 07 04:37:36 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:37:36 user nova-compute[74540]:   <serial>98dfd053-3420-4c86-b82e-536c77178c9e</serial>
Nov 07 04:37:36 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:37:36 user nova-compute[74540]: </disk>
Nov 07 04:37:36 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:37:36 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Successfully detached device vdb from instance 36935858-ea1d-4429-99b3-695ba2c26da2 from the persistent domain config.
Nov 07 04:37:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 36935858-ea1d-4429-99b3-695ba2c26da2 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:37:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:37:36 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:37:36 user nova-compute[74540]:   <source dev="/dev/sdb"/>
Nov 07 04:37:36 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:37:36 user nova-compute[74540]:   <serial>98dfd053-3420-4c86-b82e-536c77178c9e</serial>
Nov 07 04:37:36 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:37:36 user nova-compute[74540]: </disk>
Nov 07 04:37:36 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:37:36 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:37:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:56 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 36935858-ea1d-4429-99b3-695ba2c26da2 is timed out.
Nov 07 04:37:56 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Successfully detached device vdb from instance 36935858-ea1d-4429-99b3-695ba2c26da2 from the live domain config.
Nov 07 04:37:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSUJRfIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:37:56 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfed632-62d6-4266-8e2e-96dd15a5ba0d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:37:56 user nova-compute[74540]: No targets found.
Nov 07 04:37:56 user nova-compute[74540]: iSNS:
Nov 07 04:37:56 user nova-compute[74540]: No targets found.
Nov 07 04:37:56 user nova-compute[74540]: STATIC:
Nov 07 04:37:56 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e
Nov 07 04:37:56 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:37:56 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:37:56 user nova-compute[74540]: FIRMWARE:
Nov 07 04:37:56 user nova-compute[74540]: No targets found.
Nov 07 04:37:56 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:37:56 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:37:56 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71f0231-2d65-45fe-80cb-c3bb62254217]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[144dd982-51d8-4c13-a680-567a7c74b74c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e (non-flash)
Nov 07 04:37:56 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e (non-flash)
Nov 07 04:37:56 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc3f5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d01f90-e497-4058-ac97-0940f2615147]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.055s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3935cd7e-18f4-41de-9572-70660b728718]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8967d6-065d-4063-a9d7-72d5db1b0c55]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[901f7931-0c4c-41e3-a778-3dff1eb850be]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aadfa89-4617-4d87-a0d3-04dea4a77048]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf140d13-a588-4348-a8bd-fadf140eda61]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e, portal: 172.16.0.220,3260]
Nov 07 04:37:56 user nova-compute[74540]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e, portal: 172.16.0.220,3260] successful.
Nov 07 04:37:56 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98dfd053-3420-4c86-b82e-536c77178c9e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca60d277-44f5-4495-a826-c73de5d3914a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] <== disconnect_volume: return (319ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:37:56 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:37:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:37:57 user nova-compute[74540]: DEBUG nova.objects.instance [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lazy-loading 'flavor' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:37:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-053b4b42-75ee-4d2f-858c-bb65ede13a33 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.834s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:37:58 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:38:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:01 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:38:01 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:38:01 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74540) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 04:38:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:38:03 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:38:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:38:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:38:04 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:38:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:08 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:38:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:38:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:13 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:38:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 04:38:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] There are 0 instances to clean {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 04:38:15 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:38:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:38:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:38:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:38:15 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:38:15 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:38:15 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:38:16 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating instance_info_cache with network_info: [{"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:38:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:38:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:38:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:16 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:38:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:38:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:38:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:38:16 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:38:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:17 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:38:17 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:38:17 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=24.823360443115234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 36935858-ea1d-4429-99b3-695ba2c26da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing inventories for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating ProviderTree inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 04:38:17 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing aggregate associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, aggregates: None {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 04:38:18 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing trait associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 04:38:18 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:38:18 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:38:18 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:38:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:38:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "247588ec-13ba-4ea6-bcd6-9571559185d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:38:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:38:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:38:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:38:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:38:21 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:38:21 user nova-compute[74540]: INFO nova.compute.claims [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Claim successful on node user
Nov 07 04:38:21 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:38:21 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:38:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:38:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:38:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:38:21 user nova-compute[74540]: DEBUG nova.network.neutron [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:38:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:38:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:38:21 user nova-compute[74540]: DEBUG nova.policy [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23c9b2aeb83c4e2780c123bdb32b9dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96003f4fda04df99e4c1e37a139d0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:38:21 user nova-compute[74540]: INFO nova.virt.block_device [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Booting with volume snapshot 3c49b33c-576c-4d2e-a4aa-a2baa5082d8a at /dev/vda
Nov 07 04:38:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Successfully created port: 90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:38:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Successfully updated port: 90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:38:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "refresh_cache-247588ec-13ba-4ea6-bcd6-9571559185d0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:38:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquired lock "refresh_cache-247588ec-13ba-4ea6-bcd6-9571559185d0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:38:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:38:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-615d81ea-a474-472f-a986-f20dec56c362 req-49cbcda1-7792-4565-80b1-186bb0833ac1 service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Received event network-changed-90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:38:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-615d81ea-a474-472f-a986-f20dec56c362 req-49cbcda1-7792-4565-80b1-186bb0833ac1 service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Refreshing instance network info cache due to event network-changed-90b317ee-7d00-4341-a591-bab618fb5a90. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:38:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-615d81ea-a474-472f-a986-f20dec56c362 req-49cbcda1-7792-4565-80b1-186bb0833ac1 service nova] Acquiring lock "refresh_cache-247588ec-13ba-4ea6-bcd6-9571559185d0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:38:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:38:23 user nova-compute[74540]: DEBUG nova.network.neutron [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Updating instance_info_cache with network_info: [{"id": "90b317ee-7d00-4341-a591-bab618fb5a90", "address": "fa:16:3e:07:47:19", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b317ee-7d", "ovs_interfaceid": "90b317ee-7d00-4341-a591-bab618fb5a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:38:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Releasing lock "refresh_cache-247588ec-13ba-4ea6-bcd6-9571559185d0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:38:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Instance network_info: |[{"id": "90b317ee-7d00-4341-a591-bab618fb5a90", "address": "fa:16:3e:07:47:19", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b317ee-7d", "ovs_interfaceid": "90b317ee-7d00-4341-a591-bab618fb5a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:38:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-615d81ea-a474-472f-a986-f20dec56c362 req-49cbcda1-7792-4565-80b1-186bb0833ac1 service nova] Acquired lock "refresh_cache-247588ec-13ba-4ea6-bcd6-9571559185d0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:38:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-615d81ea-a474-472f-a986-f20dec56c362 req-49cbcda1-7792-4565-80b1-186bb0833ac1 service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Refreshing network info cache for port 90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:38:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-615d81ea-a474-472f-a986-f20dec56c362 req-49cbcda1-7792-4565-80b1-186bb0833ac1 service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Updated VIF entry in instance network info cache for port 90b317ee-7d00-4341-a591-bab618fb5a90. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:38:23 user nova-compute[74540]: DEBUG nova.network.neutron [req-615d81ea-a474-472f-a986-f20dec56c362 req-49cbcda1-7792-4565-80b1-186bb0833ac1 service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Updating instance_info_cache with network_info: [{"id": "90b317ee-7d00-4341-a591-bab618fb5a90", "address": "fa:16:3e:07:47:19", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b317ee-7d", "ovs_interfaceid": "90b317ee-7d00-4341-a591-bab618fb5a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:38:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-615d81ea-a474-472f-a986-f20dec56c362 req-49cbcda1-7792-4565-80b1-186bb0833ac1 service nova] Releasing lock "refresh_cache-247588ec-13ba-4ea6-bcd6-9571559185d0" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG os_brick.utils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb30f9e0-49fc-406d-9f1a-7c8c9b52bcfa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a26fa13-b109-4a72-be32-e207b753fee6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[397dcc43-c5f7-469c-85f4-f33297d74904]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f858206c-cf7a-4f52-8eb8-cd914bca814a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:38:27 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:38:27 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b434d2c-928c-4a7b-a983-e6f3fbb2734c]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG os_brick.utils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:38:27 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Updating existing volume attachment record: 96d3d44f-45bc-455a-ab4a-18e46395f483 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lazy-loading 'flavor' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:38:32 user nova-compute[74540]: INFO nova.compute.manager [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Attaching volume a043f357-d470-4d08-95aa-881483ca5d81 to /dev/vdb
Nov 07 04:38:32 user nova-compute[74540]: DEBUG os_brick.utils [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2049cdc6-5723-4c7a-a908-404a37d2f954]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1afb621-9ab6-4732-913e-678fad070e27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de0e2e5-98c9-4362-b44b-79a354bebf74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa1ec60-80b3-4362-89cc-0e58d61e2feb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:38:32 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:38:32 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb32f828-72ff-4075-b350-cec3fe69a9b1]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG os_brick.utils [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:38:32 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating existing volume attachment record: 73d724c7-3336-4f9d-9413-b81ae5de542d {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:38:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:38:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:38:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:38:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:38:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.compute.manager [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:38:48 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Creating image(s)
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Ensure instance console log exists: /opt/stack/data/nova/instances/247588ec-13ba-4ea6-bcd6-9571559185d0/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Start _get_guest_xml network_info=[{"id": "90b317ee-7d00-4341-a591-bab618fb5a90", "address": "fa:16:3e:07:47:19", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b317ee-7d", "ovs_interfaceid": "90b317ee-7d00-4341-a591-bab618fb5a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZmMfatD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '247588ec-13ba-4ea6-bcd6-9571559185d0', 'attached_at': '', 'detached_at': '', 'volume_id': '93407cdd-e637-40e9-b961-235f50e602b7', 'serial': '93407cdd-e637-40e9-b961-235f50e602b7'}, 'boot_index': 0, 'attachment_id': '96d3d44f-45bc-455a-ab4a-18e46395f483', 'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:38:48 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:38:48 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZmMfatD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:38:48 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:38:48 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:38:48 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:38:48 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:38:48 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab8d8de-a540-45ea-8216-4bbb24cf1a44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:38:48 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28b2248-6cb5-49e7-9c3c-33b8850924ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7] added
Nov 07 04:38:48 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5ff293-782a-4269-ada0-a199360cb47b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f76fe49-5044-47a0-862d-03545e674716]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:48 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZmMfatD {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZmMfatD" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8f3b92-0506-42e0-a5b3-e254959f69e8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EZmMfatD'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca153334-67c3-44b7-80d9-be578e651373]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[92290760-29b1-4e33-ba03-0ff34b74e96c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:38:49 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:38:49 user nova-compute[74540]:  {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:38:49 user nova-compute[74540]: WARNING os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 04:38:49 user nova-compute[74540]: 
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5c2963-e431-4cfa-96c1-bcb978adb11c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7, portal: 172.16.0.220,3260]
Nov 07 04:38:49 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7, portal: 172.16.0.220,3260] successful.
Nov 07 04:38:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04c5f9e-6a2a-40b3-9524-f799ae20aa39]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece29cc9-5ea8-459e-b243-0fb66f217fd3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)
Nov 07 04:38:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)
Nov 07 04:38:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce1c6af-6d39-4d66-a4f2-71c7bb60bf84]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZmMfatD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23563636361396233', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563636361396233', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1443094119',display_name='tempest-TestVolumeBootPattern-server-1443094119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1443094119',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-crdsdoei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:38:21Z,user_data=None,user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=247588ec-13ba-4ea6-bcd6-9571559185d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90b317ee-7d00-4341-a591-bab618fb5a90", "address": "fa:16:3e:07:47:19", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b317ee-7d", "ovs_interfaceid": "90b317ee-7d00-4341-a591-bab618fb5a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "90b317ee-7d00-4341-a591-bab618fb5a90", "address": "fa:16:3e:07:47:19", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b317ee-7d", "ovs_interfaceid": "90b317ee-7d00-4341-a591-bab618fb5a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:47:19,bridge_name='br-int',has_traffic_filtering=True,id=90b317ee-7d00-4341-a591-bab618fb5a90,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b317ee-7d') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG nova.objects.instance [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lazy-loading 'pci_devices' on Instance uuid 247588ec-13ba-4ea6-bcd6-9571559185d0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:38:50 user nova-compute[74540]:   <uuid>247588ec-13ba-4ea6-bcd6-9571559185d0</uuid>
Nov 07 04:38:50 user nova-compute[74540]:   <name>instance-0000002f</name>
Nov 07 04:38:50 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:38:50 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:38:50 user nova-compute[74540]:   <metadata>
Nov 07 04:38:50 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:38:50 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:38:50 user nova-compute[74540]:       <nova:name>tempest-TestVolumeBootPattern-server-1443094119</nova:name>
Nov 07 04:38:50 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:38:48</nova:creationTime>
Nov 07 04:38:50 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:38:50 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:38:50 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:38:50 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:38:50 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:38:50 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:38:50 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:38:50 user nova-compute[74540]:       <nova:owner>
Nov 07 04:38:50 user nova-compute[74540]:         <nova:user uuid="23c9b2aeb83c4e2780c123bdb32b9dde">tempest-TestVolumeBootPattern-621203767-project-member</nova:user>
Nov 07 04:38:50 user nova-compute[74540]:         <nova:project uuid="b96003f4fda04df99e4c1e37a139d0f1">tempest-TestVolumeBootPattern-621203767</nova:project>
Nov 07 04:38:50 user nova-compute[74540]:       </nova:owner>
Nov 07 04:38:50 user nova-compute[74540]:       <nova:ports>
Nov 07 04:38:50 user nova-compute[74540]:         <nova:port uuid="90b317ee-7d00-4341-a591-bab618fb5a90">
Nov 07 04:38:50 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 07 04:38:50 user nova-compute[74540]:         </nova:port>
Nov 07 04:38:50 user nova-compute[74540]:       </nova:ports>
Nov 07 04:38:50 user nova-compute[74540]:     </nova:instance>
Nov 07 04:38:50 user nova-compute[74540]:   </metadata>
Nov 07 04:38:50 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:38:50 user nova-compute[74540]:     <system>
Nov 07 04:38:50 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:38:50 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:38:50 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:38:50 user nova-compute[74540]:       <entry name="serial">247588ec-13ba-4ea6-bcd6-9571559185d0</entry>
Nov 07 04:38:50 user nova-compute[74540]:       <entry name="uuid">247588ec-13ba-4ea6-bcd6-9571559185d0</entry>
Nov 07 04:38:50 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:38:50 user nova-compute[74540]:     </system>
Nov 07 04:38:50 user nova-compute[74540]:   </sysinfo>
Nov 07 04:38:50 user nova-compute[74540]:   <os>
Nov 07 04:38:50 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:38:50 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:38:50 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:38:50 user nova-compute[74540]:   </os>
Nov 07 04:38:50 user nova-compute[74540]:   <features>
Nov 07 04:38:50 user nova-compute[74540]:     <acpi/>
Nov 07 04:38:50 user nova-compute[74540]:     <apic/>
Nov 07 04:38:50 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:38:50 user nova-compute[74540]:   </features>
Nov 07 04:38:50 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:38:50 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:38:50 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:38:50 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:38:50 user nova-compute[74540]:   </clock>
Nov 07 04:38:50 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:38:50 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:38:50 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:38:50 user nova-compute[74540]:   </cpu>
Nov 07 04:38:50 user nova-compute[74540]:   <devices>
Nov 07 04:38:50 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:38:50 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:38:50 user nova-compute[74540]:       <source dev="/dev/sdb"/>
Nov 07 04:38:50 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:38:50 user nova-compute[74540]:       <serial>93407cdd-e637-40e9-b961-235f50e602b7</serial>
Nov 07 04:38:50 user nova-compute[74540]:     </disk>
Nov 07 04:38:50 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:38:50 user nova-compute[74540]:       <mac address="fa:16:3e:07:47:19"/>
Nov 07 04:38:50 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:38:50 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:38:50 user nova-compute[74540]:       <target dev="tap90b317ee-7d"/>
Nov 07 04:38:50 user nova-compute[74540]:     </interface>
Nov 07 04:38:50 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:38:50 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/247588ec-13ba-4ea6-bcd6-9571559185d0/console.log" append="off"/>
Nov 07 04:38:50 user nova-compute[74540]:     </serial>
Nov 07 04:38:50 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:38:50 user nova-compute[74540]:     <video>
Nov 07 04:38:50 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:38:50 user nova-compute[74540]:     </video>
Nov 07 04:38:50 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:38:50 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:38:50 user nova-compute[74540]:     </rng>
Nov 07 04:38:50 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:38:50 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:38:50 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:38:50 user nova-compute[74540]:     </memballoon>
Nov 07 04:38:50 user nova-compute[74540]:   </devices>
Nov 07 04:38:50 user nova-compute[74540]: </domain>
Nov 07 04:38:50 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1443094119',display_name='tempest-TestVolumeBootPattern-server-1443094119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1443094119',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-crdsdoei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:38:21Z,user_data=None,user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=247588ec-13ba-4ea6-bcd6-9571559185d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90b317ee-7d00-4341-a591-bab618fb5a90", "address": "fa:16:3e:07:47:19", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b317ee-7d", "ovs_interfaceid": "90b317ee-7d00-4341-a591-bab618fb5a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "90b317ee-7d00-4341-a591-bab618fb5a90", "address": "fa:16:3e:07:47:19", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b317ee-7d", "ovs_interfaceid": "90b317ee-7d00-4341-a591-bab618fb5a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:47:19,bridge_name='br-int',has_traffic_filtering=True,id=90b317ee-7d00-4341-a591-bab618fb5a90,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b317ee-7d') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG os_vif [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:47:19,bridge_name='br-int',has_traffic_filtering=True,id=90b317ee-7d00-4341-a591-bab618fb5a90,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b317ee-7d') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f2d2b00-fb2b-578b-a462-3ca96c4ba7e5', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90b317ee-7d, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90b317ee-7d, col_values=(('qos', UUID('3c45159c-f04e-488a-bbb0-0076b7f29dcf')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90b317ee-7d, col_values=(('external_ids', {'iface-id': '90b317ee-7d00-4341-a591-bab618fb5a90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:47:19', 'vm-uuid': '247588ec-13ba-4ea6-bcd6-9571559185d0'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:50 user nova-compute[74540]: INFO os_vif [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:47:19,bridge_name='br-int',has_traffic_filtering=True,id=90b317ee-7d00-4341-a591-bab618fb5a90,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b317ee-7d')
Nov 07 04:38:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:38:50 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] No VIF found with MAC fa:16:3e:07:47:19, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:38:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:51 user nova-compute[74540]: DEBUG nova.compute.manager [req-bd29b089-bafa-4390-ac40-b8311f84304b req-86488e7b-44e7-4cb2-86ac-72557c05682d service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Received event network-vif-plugged-90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:38:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bd29b089-bafa-4390-ac40-b8311f84304b req-86488e7b-44e7-4cb2-86ac-72557c05682d service nova] Acquiring lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:38:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bd29b089-bafa-4390-ac40-b8311f84304b req-86488e7b-44e7-4cb2-86ac-72557c05682d service nova] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:38:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bd29b089-bafa-4390-ac40-b8311f84304b req-86488e7b-44e7-4cb2-86ac-72557c05682d service nova] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:38:51 user nova-compute[74540]: DEBUG nova.compute.manager [req-bd29b089-bafa-4390-ac40-b8311f84304b req-86488e7b-44e7-4cb2-86ac-72557c05682d service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] No waiting events found dispatching network-vif-plugged-90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:38:51 user nova-compute[74540]: WARNING nova.compute.manager [req-bd29b089-bafa-4390-ac40-b8311f84304b req-86488e7b-44e7-4cb2-86ac-72557c05682d service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Received unexpected event network-vif-plugged-90b317ee-7d00-4341-a591-bab618fb5a90 for instance with vm_state building and task_state spawning.
Nov 07 04:38:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:38:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:38:53 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Instance spawned successfully.
Nov 07 04:38:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:38:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:38:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:38:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:38:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:38:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:38:53 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:38:53 user nova-compute[74540]: INFO nova.compute.manager [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 07 04:38:53 user nova-compute[74540]: DEBUG nova.compute.manager [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:38:53 user nova-compute[74540]: INFO nova.compute.manager [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Took 32.92 seconds to build instance.
Nov 07 04:38:53 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-39831073-c56a-4066-9da5-79da8e91de11 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.018s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-31f7a73d-1daa-4d31-9e1e-57ace4ef71fd req-439eb9d8-3ad9-4437-8877-2bfe77bba0b3 service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Received event network-vif-plugged-90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-31f7a73d-1daa-4d31-9e1e-57ace4ef71fd req-439eb9d8-3ad9-4437-8877-2bfe77bba0b3 service nova] Acquiring lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-31f7a73d-1daa-4d31-9e1e-57ace4ef71fd req-439eb9d8-3ad9-4437-8877-2bfe77bba0b3 service nova] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-31f7a73d-1daa-4d31-9e1e-57ace4ef71fd req-439eb9d8-3ad9-4437-8877-2bfe77bba0b3 service nova] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-31f7a73d-1daa-4d31-9e1e-57ace4ef71fd req-439eb9d8-3ad9-4437-8877-2bfe77bba0b3 service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] No waiting events found dispatching network-vif-plugged-90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:38:54 user nova-compute[74540]: WARNING nova.compute.manager [req-31f7a73d-1daa-4d31-9e1e-57ace4ef71fd req-439eb9d8-3ad9-4437-8877-2bfe77bba0b3 service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Received unexpected event network-vif-plugged-90b317ee-7d00-4341-a591-bab618fb5a90 for instance with vm_state active and task_state None.
Nov 07 04:38:54 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGJqDNKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:38:54 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:38:54 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:38:54 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2ec903-af95-483a-abef-ed6ec19862b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:38:54 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[206392f6-78d2-4450-97a4-d877ad1094cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81] added
Nov 07 04:38:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a50c1a2-56e3-4d64-8ce2-b8234ca30660]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa81add-94d0-4ed7-8e2e-160aa3da25a0]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGJqDNKO {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGJqDNKO" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bef3ab5-b0f8-4362-8f61-9840bd4a2f35]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TGJqDNKO'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2523311f-a86d-4a1d-b537-c13fbb01d5f8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6bd049-6455-40d3-9013-50ba2f8a032b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)
Nov 07 04:38:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)
Nov 07 04:38:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee77439-45b8-4e14-888e-3dc8bf14e5a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81, portal: 172.16.0.220,3260]
Nov 07 04:38:54 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81, portal: 172.16.0.220,3260] successful.
Nov 07 04:38:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e134e0ae-4e71-4cca-b5d8-257485a78f8f]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f479e1-78d5-4b21-aafa-0a653a7a620f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)
Nov 07 04:38:54 user nova-compute[74540]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 (non-flash)
Nov 07 04:38:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)
Nov 07 04:38:54 user nova-compute[74540]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 (non-flash)
Nov 07 04:38:54 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d12fff9-66c7-4ee5-84ef-751e3de2b51e]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:38:54 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:38:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:55 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:38:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGJqDNKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:38:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:38:55 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26639653764666632', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:38:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639653764666632', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:38:55 user nova-compute[74540]: DEBUG nova.objects.instance [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lazy-loading 'flavor' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:38:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] attach device xml: <disk type="block" device="disk">
Nov 07 04:38:55 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:38:55 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:38:55 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:38:55 user nova-compute[74540]:   <serial>a043f357-d470-4d08-95aa-881483ca5d81</serial>
Nov 07 04:38:55 user nova-compute[74540]: </disk>
Nov 07 04:38:55 user nova-compute[74540]:  {{(pid=74540) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 07 04:38:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:38:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:38:55 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] No VIF found with MAC fa:16:3e:91:3a:5c, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:38:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-ccfa1d24-a083-4f57-b6f1-5e99e65168b8 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.299s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:38:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:38:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:38:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:38:57 user nova-compute[74540]: INFO nova.compute.manager [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Detaching volume a043f357-d470-4d08-95aa-881483ca5d81
Nov 07 04:38:57 user nova-compute[74540]: INFO nova.virt.block_device [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Attempting to driver detach volume a043f357-d470-4d08-95aa-881483ca5d81 from mountpoint /dev/vdb
Nov 07 04:38:57 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Attempting to detach device vdb from instance 36935858-ea1d-4429-99b3-695ba2c26da2 from the persistent domain config. {{(pid=74540) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 07 04:38:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:38:58 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:38:58 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:38:58 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:38:58 user nova-compute[74540]:   <serial>a043f357-d470-4d08-95aa-881483ca5d81</serial>
Nov 07 04:38:58 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:38:58 user nova-compute[74540]: </disk>
Nov 07 04:38:58 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:38:58 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Successfully detached device vdb from instance 36935858-ea1d-4429-99b3-695ba2c26da2 from the persistent domain config.
Nov 07 04:38:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 36935858-ea1d-4429-99b3-695ba2c26da2 from the live domain config. {{(pid=74540) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 07 04:38:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.guest [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] detach device xml: <disk type="block" device="disk">
Nov 07 04:38:58 user nova-compute[74540]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:38:58 user nova-compute[74540]:   <source dev="/dev/sdc"/>
Nov 07 04:38:58 user nova-compute[74540]:   <target dev="vdb" bus="virtio"/>
Nov 07 04:38:58 user nova-compute[74540]:   <serial>a043f357-d470-4d08-95aa-881483ca5d81</serial>
Nov 07 04:38:58 user nova-compute[74540]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 07 04:38:58 user nova-compute[74540]: </disk>
Nov 07 04:38:58 user nova-compute[74540]:  {{(pid=74540) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 07 04:38:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 07 04:39:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:03 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:39:03 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:39:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:39:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:39:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:06 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:39:06 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:39:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:39:08 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:39:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:39:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:16 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:39:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:39:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:39:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:39:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:39:16 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:39:16 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:39:17 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating instance_info_cache with network_info: [{"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:39:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:39:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:39:17 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:39:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:39:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:39:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:39:17 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:39:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:39:18 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 36935858-ea1d-4429-99b3-695ba2c26da2 is timed out.
Nov 07 04:39:18 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Successfully detached device vdb from instance 36935858-ea1d-4429-99b3-695ba2c26da2 from the live domain config.
Nov 07 04:39:18 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:39:18 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:39:18 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=24.821056365966797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGJqDNKO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:39:18 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc388c61-433a-4fbc-b705-c02724e0540c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:39:18 user nova-compute[74540]: No targets found.
Nov 07 04:39:18 user nova-compute[74540]: iSNS:
Nov 07 04:39:18 user nova-compute[74540]: No targets found.
Nov 07 04:39:18 user nova-compute[74540]: STATIC:
Nov 07 04:39:18 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81
Nov 07 04:39:18 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:39:18 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:39:18 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7
Nov 07 04:39:18 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:39:18 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:39:18 user nova-compute[74540]: FIRMWARE:
Nov 07 04:39:18 user nova-compute[74540]: No targets found.
Nov 07 04:39:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:39:18 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:39:18 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74aeb81-1bf2-4544-9d12-235431f11009]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 36935858-ea1d-4429-99b3-695ba2c26da2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 247588ec-13ba-4ea6-bcd6-9571559185d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb3f479-45ed-4e2b-8f5c-e7c57aeba663]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)
Nov 07 04:39:18 user nova-compute[74540]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 (non-flash)
Nov 07 04:39:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)
Nov 07 04:39:18 user nova-compute[74540]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 (non-flash)
Nov 07 04:39:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc7d8310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e78632-81c9-46ae-9b35-656d90efa4f5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc345fca-70f4-4f2c-965e-2db6d5a33321]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb3884f-5972-4cf8-ab08-5d8238a5f4cd]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[42edb9bc-bfda-451d-9b2b-4398519d1511]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e8ad72-d1d5-4b09-898c-8734f7f61efa]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1456bd-09cf-4faf-b67e-0d6743971b1c]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81, portal: 172.16.0.220,3260]
Nov 07 04:39:18 user nova-compute[74540]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81, portal: 172.16.0.220,3260] successful.
Nov 07 04:39:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a043f357-d470-4d08-95aa-881483ca5d81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f67fac6-87cb-4f8d-a046-f59584d4538e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] <== disconnect_volume: return (317ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:39:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:39:19 user nova-compute[74540]: DEBUG nova.objects.instance [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lazy-loading 'flavor' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:39:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a290b5fd-558c-4b16-8f8c-f4e6e334002c tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.941s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:39:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:39:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:39:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:39:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:39:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:39:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG nova.objects.instance [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lazy-loading 'flavor' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:39:54 user nova-compute[74540]: INFO nova.compute.manager [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Attaching volume ef6fed76-57a9-4120-a3dc-ab52bc7b2afb to /dev/vdb
Nov 07 04:39:54 user nova-compute[74540]: DEBUG os_brick.utils [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da70b25-d983-4421-bb16-ec9e77556f68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65df0a1-67a9-4bc7-9965-6d1b33b6afc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0ea192-65dc-4aae-b35e-4c222e07c04a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2f8d3c-b52c-41fe-a5e5-bd55da3e9d14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:39:54 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:39:54 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd30255f-ddde-4f62-bd4e-8c5249bb7624]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG os_brick.utils [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:39:54 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating existing volume attachment record: 79dbba0a-6f2c-42b8-8041-7a0c9e18a194 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:39:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:39:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:40:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:40:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:05 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:40:07 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:40:07 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:40:07 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:40:09 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:40:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "247588ec-13ba-4ea6-bcd6-9571559185d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:40:11 user nova-compute[74540]: INFO nova.compute.manager [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Terminating instance
Nov 07 04:40:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-a2b44b1c-e860-4ea3-82e2-0e3c9ff36382 req-287aac07-5332-4a73-9865-badefec2ccd9 service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Received event network-vif-unplugged-90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a2b44b1c-e860-4ea3-82e2-0e3c9ff36382 req-287aac07-5332-4a73-9865-badefec2ccd9 service nova] Acquiring lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a2b44b1c-e860-4ea3-82e2-0e3c9ff36382 req-287aac07-5332-4a73-9865-badefec2ccd9 service nova] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-a2b44b1c-e860-4ea3-82e2-0e3c9ff36382 req-287aac07-5332-4a73-9865-badefec2ccd9 service nova] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-a2b44b1c-e860-4ea3-82e2-0e3c9ff36382 req-287aac07-5332-4a73-9865-badefec2ccd9 service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] No waiting events found dispatching network-vif-unplugged-90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:40:11 user nova-compute[74540]: DEBUG nova.compute.manager [req-a2b44b1c-e860-4ea3-82e2-0e3c9ff36382 req-287aac07-5332-4a73-9865-badefec2ccd9 service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Received event network-vif-unplugged-90b317ee-7d00-4341-a591-bab618fb5a90 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:12 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Instance destroyed successfully.
Nov 07 04:40:12 user nova-compute[74540]: DEBUG nova.objects.instance [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lazy-loading 'resources' on Instance uuid 247588ec-13ba-4ea6-bcd6-9571559185d0 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1443094119',display_name='tempest-TestVolumeBootPattern-server-1443094119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1443094119',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:38:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-crdsdoei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:38:54Z,user_data=None,user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=247588ec-13ba-4ea6-bcd6-9571559185d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90b317ee-7d00-4341-a591-bab618fb5a90", "address": "fa:16:3e:07:47:19", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b317ee-7d", "ovs_interfaceid": "90b317ee-7d00-4341-a591-bab618fb5a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "90b317ee-7d00-4341-a591-bab618fb5a90", "address": "fa:16:3e:07:47:19", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90b317ee-7d", "ovs_interfaceid": "90b317ee-7d00-4341-a591-bab618fb5a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:47:19,bridge_name='br-int',has_traffic_filtering=True,id=90b317ee-7d00-4341-a591-bab618fb5a90,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b317ee-7d') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_vif [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:47:19,bridge_name='br-int',has_traffic_filtering=True,id=90b317ee-7d00-4341-a591-bab618fb5a90,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b317ee-7d') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90b317ee-7d, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c45159c-f04e-488a-bbb0-0076b7f29dcf) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:40:12 user nova-compute[74540]: INFO os_vif [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:47:19,bridge_name='br-int',has_traffic_filtering=True,id=90b317ee-7d00-4341-a591-bab618fb5a90,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90b317ee-7d')
Nov 07 04:40:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZmMfatD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:40:12 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc70d07-5b09-4a95-a8bd-3d05bf442cf0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:40:12 user nova-compute[74540]: No targets found.
Nov 07 04:40:12 user nova-compute[74540]: iSNS:
Nov 07 04:40:12 user nova-compute[74540]: No targets found.
Nov 07 04:40:12 user nova-compute[74540]: STATIC:
Nov 07 04:40:12 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7
Nov 07 04:40:12 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:40:12 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:40:12 user nova-compute[74540]: FIRMWARE:
Nov 07 04:40:12 user nova-compute[74540]: No targets found.
Nov 07 04:40:12 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:40:12 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:40:12 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[66988886-a99a-474d-8a86-895e38d9dd8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34b2564-1139-4b75-a158-3f48375818f0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)
Nov 07 04:40:12 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 (non-flash)
Nov 07 04:40:12 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc7653f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c256c011-f3cb-42c1-bfed-11798ce2ea8f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3306cc7c-2e52-4c81-9e35-832fffce0b8d]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[462129de-e181-49a5-ba08-8b659ec7a6aa]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa840f5-d122-4412-afea-6ded3a0ea6c0]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e953cd-012a-448f-abd6-e82b764c1c8e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72521a5-6dfa-4230-a399-87c9459b3cd1]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7, portal: 172.16.0.220,3260]
Nov 07 04:40:12 user nova-compute[74540]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7, portal: 172.16.0.220,3260] successful.
Nov 07 04:40:12 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93407cdd-e637-40e9-b961-235f50e602b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a120681b-ca61-4e57-ac67-440efe791447]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== disconnect_volume: return (326ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:40:12 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Deleting instance files /opt/stack/data/nova/instances/247588ec-13ba-4ea6-bcd6-9571559185d0_del
Nov 07 04:40:12 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Deletion of /opt/stack/data/nova/instances/247588ec-13ba-4ea6-bcd6-9571559185d0_del complete
Nov 07 04:40:12 user nova-compute[74540]: INFO nova.compute.manager [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 07 04:40:12 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:40:12 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:40:13 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:40:13 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Took 0.47 seconds to deallocate network for instance.
Nov 07 04:40:13 user nova-compute[74540]: DEBUG nova.compute.manager [req-e1f248c7-3e27-4e53-a8eb-faec808db5be req-1549b774-08fe-48bb-ac48-f9948ae6c16f service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Received event network-vif-deleted-90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:40:14 user nova-compute[74540]: DEBUG nova.compute.manager [req-2dc5fd48-4c20-4c30-b40d-f960feaeb0fb req-b4968932-27ce-4833-9ae9-fd744312290f service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Received event network-vif-plugged-90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:40:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-2dc5fd48-4c20-4c30-b40d-f960feaeb0fb req-b4968932-27ce-4833-9ae9-fd744312290f service nova] Acquiring lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:40:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-2dc5fd48-4c20-4c30-b40d-f960feaeb0fb req-b4968932-27ce-4833-9ae9-fd744312290f service nova] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:40:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-2dc5fd48-4c20-4c30-b40d-f960feaeb0fb req-b4968932-27ce-4833-9ae9-fd744312290f service nova] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:40:14 user nova-compute[74540]: DEBUG nova.compute.manager [req-2dc5fd48-4c20-4c30-b40d-f960feaeb0fb req-b4968932-27ce-4833-9ae9-fd744312290f service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] No waiting events found dispatching network-vif-plugged-90b317ee-7d00-4341-a591-bab618fb5a90 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:40:14 user nova-compute[74540]: WARNING nova.compute.manager [req-2dc5fd48-4c20-4c30-b40d-f960feaeb0fb req-b4968932-27ce-4833-9ae9-fd744312290f service nova] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Received unexpected event network-vif-plugged-90b317ee-7d00-4341-a591-bab618fb5a90 for instance with vm_state active and task_state deleting.
Nov 07 04:40:14 user nova-compute[74540]: INFO nova.compute.manager [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Took 0.89 seconds to detach 1 volumes for instance.
Nov 07 04:40:14 user nova-compute[74540]: DEBUG nova.compute.manager [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 247588ec-13ba-4ea6-bcd6-9571559185d0] Deleting volume: 93407cdd-e637-40e9-b961-235f50e602b7 {{(pid=74540) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 07 04:40:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:40:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:40:14 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:40:14 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:40:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:40:14 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Deleted allocations for instance 247588ec-13ba-4ea6-bcd6-9571559185d0
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.volume.cinder [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Update attachment failed for attachment 79dbba0a-6f2c-42b8-8041-7a0c9e18a194. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ffeab2d5-6260-47bc-a967-7bd5af0b0c5c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ffeab2d5-6260-47bc-a967-7bd5af0b0c5c)
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Failed to attach ef6fed76-57a9-4120-a3dc-ab52bc7b2afb at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ffeab2d5-6260-47bc-a967-7bd5af0b0c5c)
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Traceback (most recent call last):
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     ret_val = method(obj, context, *args, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     self._do_attach(context, instance, volume, volume_api,
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     self._volume_attach(context, volume, connector, instance,
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     connection_info = volume_api.attachment_update(
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     res = method(self, ctx, *args, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     with excutils.save_and_reraise_exception():
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     self.force_reraise()
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     raise self.value
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     context, '3.44', skip_version_check=True).attachments.update(
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     return method.func(obj, *args, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     resp = self._update('/attachments/%s' % id, body)
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     return self._cs_request(url, 'PUT', **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     return self.request(url, method, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2]     raise exceptions.from_response(resp, body)
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ffeab2d5-6260-47bc-a967-7bd5af0b0c5c)
Nov 07 04:40:14 user nova-compute[74540]: ERROR nova.compute.manager [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] 
Nov 07 04:40:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-01275fff-9510-4209-a7f9-115039c7b6ac tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "247588ec-13ba-4ea6-bcd6-9571559185d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.061s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:40:14 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.396s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server [None req-b65ed243-3007-4583-bcb2-d264da841091 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ffeab2d5-6260-47bc-a967-7bd5af0b0c5c)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ffeab2d5-6260-47bc-a967-7bd5af0b0c5c)
Nov 07 04:40:14 user nova-compute[74540]: ERROR oslo_messaging.rpc.server 
Nov 07 04:40:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:17 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:40:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:40:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 04:40:17 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:40:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:40:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:40:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:40:17 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:40:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:40:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:40:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:40:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:40:18 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:40:18 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:40:18 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8942MB free_disk=24.812076568603516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:40:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:40:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:40:18 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 36935858-ea1d-4429-99b3-695ba2c26da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:40:18 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:40:18 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:40:18 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:40:18 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:40:18 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:40:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:40:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:40:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:40:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:40:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:40:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:40:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:40:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:40:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:40:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:40:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:40:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:40:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:41:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:41:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:41:05 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:41:05 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:41:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:41:07 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:41:08 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:41:08 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:41:09 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:41:09 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:41:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:41:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:41:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:41:18 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:41:18 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:41:18 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:41:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:41:18 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:41:18 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:41:18 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:41:19 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating instance_info_cache with network_info: [{"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:41:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:41:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:41:19 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:41:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:41:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:41:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:41:19 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:41:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:41:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:41:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:41:19 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:41:20 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:41:20 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:41:20 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=24.81100845336914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:41:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:41:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:41:20 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 36935858-ea1d-4429-99b3-695ba2c26da2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:41:20 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:41:20 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:41:20 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:41:20 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:41:20 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:41:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:41:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:41:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:41:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:41:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:41:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:41:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:41:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:41:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:41:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:41:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:41:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:41:43 user nova-compute[74540]: INFO nova.compute.claims [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Claim successful on node user
Nov 07 04:41:43 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:41:43 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:41:43 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:41:43 user nova-compute[74540]: INFO nova.virt.block_device [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Booting with volume b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 at /dev/vda
Nov 07 04:41:43 user nova-compute[74540]: DEBUG nova.policy [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23c9b2aeb83c4e2780c123bdb32b9dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96003f4fda04df99e4c1e37a139d0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG os_brick.utils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdad079d-aefd-4974-b819-084cb22353e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ecda48-4da1-453a-936f-8088b68357a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[21da4566-f8c3-40a5-849d-e4dac0a2a35d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[135b191c-f9ec-401e-8bbe-f06adc278938]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:41:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:41:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:41:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:41:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:41:44 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:41:44 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:41:44 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a652a8e-f357-46ea-bb74-fc4222cdc2b5]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:41:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:41:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:41:44 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:41:44 user nova-compute[74540]: DEBUG os_brick.utils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:41:44 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updating existing volume attachment record: 1f203a9b-9a20-41bc-8e85-dddc0eeb9eec {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:41:44 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Successfully created port: 55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Successfully updated port: 55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquired lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG nova.compute.manager [req-c3b4bd9d-de26-4000-8945-24b207c8e79d req-aa52f74e-41d6-49bc-8984-4ea059818ded service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Received event network-changed-55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG nova.compute.manager [req-c3b4bd9d-de26-4000-8945-24b207c8e79d req-aa52f74e-41d6-49bc-8984-4ea059818ded service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Refreshing instance network info cache due to event network-changed-55567e31-8cb7-4203-8b47-db6d99688298. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c3b4bd9d-de26-4000-8945-24b207c8e79d req-aa52f74e-41d6-49bc-8984-4ea059818ded service nova] Acquiring lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG nova.network.neutron [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updating instance_info_cache with network_info: [{"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Releasing lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Instance network_info: |[{"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c3b4bd9d-de26-4000-8945-24b207c8e79d req-aa52f74e-41d6-49bc-8984-4ea059818ded service nova] Acquired lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:41:45 user nova-compute[74540]: DEBUG nova.network.neutron [req-c3b4bd9d-de26-4000-8945-24b207c8e79d req-aa52f74e-41d6-49bc-8984-4ea059818ded service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Refreshing network info cache for port 55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:41:46 user nova-compute[74540]: DEBUG nova.network.neutron [req-c3b4bd9d-de26-4000-8945-24b207c8e79d req-aa52f74e-41d6-49bc-8984-4ea059818ded service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updated VIF entry in instance network info cache for port 55567e31-8cb7-4203-8b47-db6d99688298. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:41:46 user nova-compute[74540]: DEBUG nova.network.neutron [req-c3b4bd9d-de26-4000-8945-24b207c8e79d req-aa52f74e-41d6-49bc-8984-4ea059818ded service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updating instance_info_cache with network_info: [{"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:41:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-c3b4bd9d-de26-4000-8945-24b207c8e79d req-aa52f74e-41d6-49bc-8984-4ea059818ded service nova] Releasing lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:41:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:41:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:41:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:42:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:42:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:42:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:42:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:42:04 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Creating image(s)
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Ensure instance console log exists: /opt/stack/data/nova/instances/e2d803ae-4fa4-419e-a116-0e0c24e1953a/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Start _get_guest_xml network_info=[{"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqkEyVUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e2d803ae-4fa4-419e-a116-0e0c24e1953a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7', 'serial': 'b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7'}, 'boot_index': 0, 'attachment_id': '1f203a9b-9a20-41bc-8e85-dddc0eeb9eec', 'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:42:04 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:42:04 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqkEyVUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:42:04 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:42:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:42:04 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:42:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:42:04 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9424a1ea-c93a-4f0e-9872-5def89e0a947]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:42:04 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8f73e0-5be0-4c96-9c53-f9973129033b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7] added
Nov 07 04:42:04 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7ff241-f0b1-4fd3-a096-5d12a8d8a943]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ca288b-ffa6-4bf5-b172-9267ac72c260]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:42:04 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqkEyVUK {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqkEyVUK" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af916a6-9a06-4036-ba34-62e1e1caeeeb]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sqkEyVUK'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60baac5-4a9d-4bf3-a413-d995d5e30c1d]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c5aa72-3a7e-4688-b382-455ec5e35c96]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:42:05 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:42:05 user nova-compute[74540]:  {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:42:05 user nova-compute[74540]: WARNING os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 04:42:05 user nova-compute[74540]: 
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[59490c5e-6265-45f6-b364-a4a4afb46026]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7, portal: 172.16.0.220,3260]
Nov 07 04:42:05 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7, portal: 172.16.0.220,3260] successful.
Nov 07 04:42:05 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec7315a-b044-4840-b643-65f2e432a1b3]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b03c39-cf17-4c43-a741-74dd21ad446c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)
Nov 07 04:42:05 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)
Nov 07 04:42:05 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f72e56-f1e2-4519-9f03-99bfd54ffb1a]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqkEyVUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:42:05 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23465643837613661', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465643837613661', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:41:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-817994443',display_name='tempest-TestVolumeBootPattern-volume-backed-server-817994443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-817994443',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP1a40xg/q/dwuKW5aFbb3cs5XM9BU5IIw/UFhoy63crgYewR/n8ecBPPmJRZa53o6Uy5CoGwWB0skMvCRALlTxlEEjQBGXYe1oB0tJrGqbTLzwhz0nVSJnR+59TRPjNg==',key_name='tempest-keypair-1958101681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-4o8ga1gz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=e2d803ae-4fa4-419e-a116-0e0c24e1953a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ef:d3,bridge_name='br-int',has_traffic_filtering=True,id=55567e31-8cb7-4203-8b47-db6d99688298,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55567e31-8c') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lazy-loading 'pci_devices' on Instance uuid e2d803ae-4fa4-419e-a116-0e0c24e1953a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:42:06 user nova-compute[74540]:   <uuid>e2d803ae-4fa4-419e-a116-0e0c24e1953a</uuid>
Nov 07 04:42:06 user nova-compute[74540]:   <name>instance-00000030</name>
Nov 07 04:42:06 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:42:06 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:42:06 user nova-compute[74540]:   <metadata>
Nov 07 04:42:06 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:42:06 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:42:06 user nova-compute[74540]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-817994443</nova:name>
Nov 07 04:42:06 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:42:04</nova:creationTime>
Nov 07 04:42:06 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:42:06 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:42:06 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:42:06 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:42:06 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:42:06 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:42:06 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:42:06 user nova-compute[74540]:       <nova:owner>
Nov 07 04:42:06 user nova-compute[74540]:         <nova:user uuid="23c9b2aeb83c4e2780c123bdb32b9dde">tempest-TestVolumeBootPattern-621203767-project-member</nova:user>
Nov 07 04:42:06 user nova-compute[74540]:         <nova:project uuid="b96003f4fda04df99e4c1e37a139d0f1">tempest-TestVolumeBootPattern-621203767</nova:project>
Nov 07 04:42:06 user nova-compute[74540]:       </nova:owner>
Nov 07 04:42:06 user nova-compute[74540]:       <nova:ports>
Nov 07 04:42:06 user nova-compute[74540]:         <nova:port uuid="55567e31-8cb7-4203-8b47-db6d99688298">
Nov 07 04:42:06 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 07 04:42:06 user nova-compute[74540]:         </nova:port>
Nov 07 04:42:06 user nova-compute[74540]:       </nova:ports>
Nov 07 04:42:06 user nova-compute[74540]:     </nova:instance>
Nov 07 04:42:06 user nova-compute[74540]:   </metadata>
Nov 07 04:42:06 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:42:06 user nova-compute[74540]:     <system>
Nov 07 04:42:06 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:42:06 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:42:06 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:42:06 user nova-compute[74540]:       <entry name="serial">e2d803ae-4fa4-419e-a116-0e0c24e1953a</entry>
Nov 07 04:42:06 user nova-compute[74540]:       <entry name="uuid">e2d803ae-4fa4-419e-a116-0e0c24e1953a</entry>
Nov 07 04:42:06 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:42:06 user nova-compute[74540]:     </system>
Nov 07 04:42:06 user nova-compute[74540]:   </sysinfo>
Nov 07 04:42:06 user nova-compute[74540]:   <os>
Nov 07 04:42:06 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:42:06 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:42:06 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:42:06 user nova-compute[74540]:   </os>
Nov 07 04:42:06 user nova-compute[74540]:   <features>
Nov 07 04:42:06 user nova-compute[74540]:     <acpi/>
Nov 07 04:42:06 user nova-compute[74540]:     <apic/>
Nov 07 04:42:06 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:42:06 user nova-compute[74540]:   </features>
Nov 07 04:42:06 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:42:06 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:42:06 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:42:06 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:42:06 user nova-compute[74540]:   </clock>
Nov 07 04:42:06 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:42:06 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:42:06 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:42:06 user nova-compute[74540]:   </cpu>
Nov 07 04:42:06 user nova-compute[74540]:   <devices>
Nov 07 04:42:06 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:42:06 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:42:06 user nova-compute[74540]:       <source dev="/dev/sdb"/>
Nov 07 04:42:06 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:42:06 user nova-compute[74540]:       <serial>b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7</serial>
Nov 07 04:42:06 user nova-compute[74540]:     </disk>
Nov 07 04:42:06 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:42:06 user nova-compute[74540]:       <mac address="fa:16:3e:0d:ef:d3"/>
Nov 07 04:42:06 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:42:06 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:42:06 user nova-compute[74540]:       <target dev="tap55567e31-8c"/>
Nov 07 04:42:06 user nova-compute[74540]:     </interface>
Nov 07 04:42:06 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:42:06 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/e2d803ae-4fa4-419e-a116-0e0c24e1953a/console.log" append="off"/>
Nov 07 04:42:06 user nova-compute[74540]:     </serial>
Nov 07 04:42:06 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:42:06 user nova-compute[74540]:     <video>
Nov 07 04:42:06 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:42:06 user nova-compute[74540]:     </video>
Nov 07 04:42:06 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:42:06 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:42:06 user nova-compute[74540]:     </rng>
Nov 07 04:42:06 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:42:06 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:42:06 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:42:06 user nova-compute[74540]:     </memballoon>
Nov 07 04:42:06 user nova-compute[74540]:   </devices>
Nov 07 04:42:06 user nova-compute[74540]: </domain>
Nov 07 04:42:06 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:41:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-817994443',display_name='tempest-TestVolumeBootPattern-volume-backed-server-817994443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-817994443',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP1a40xg/q/dwuKW5aFbb3cs5XM9BU5IIw/UFhoy63crgYewR/n8ecBPPmJRZa53o6Uy5CoGwWB0skMvCRALlTxlEEjQBGXYe1oB0tJrGqbTLzwhz0nVSJnR+59TRPjNg==',key_name='tempest-keypair-1958101681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-4o8ga1gz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=e2d803ae-4fa4-419e-a116-0e0c24e1953a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ef:d3,bridge_name='br-int',has_traffic_filtering=True,id=55567e31-8cb7-4203-8b47-db6d99688298,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55567e31-8c') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG os_vif [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ef:d3,bridge_name='br-int',has_traffic_filtering=True,id=55567e31-8cb7-4203-8b47-db6d99688298,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55567e31-8c') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8dfa3f43-e8a6-5de7-bd89-5f343fa43e0a', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55567e31-8c, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55567e31-8c, col_values=(('qos', UUID('099041da-3873-4bd7-883a-b2c0510ceedf')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55567e31-8c, col_values=(('external_ids', {'iface-id': '55567e31-8cb7-4203-8b47-db6d99688298', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:ef:d3', 'vm-uuid': 'e2d803ae-4fa4-419e-a116-0e0c24e1953a'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:06 user nova-compute[74540]: INFO os_vif [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:ef:d3,bridge_name='br-int',has_traffic_filtering=True,id=55567e31-8cb7-4203-8b47-db6d99688298,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55567e31-8c')
Nov 07 04:42:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:42:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] No VIF found with MAC fa:16:3e:0d:ef:d3, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:42:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-f2f09b7d-7100-4f2c-afeb-834d930e865f req-2f66dc63-7466-40a9-8066-415effa9994f service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Received event network-vif-plugged-55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:42:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f2f09b7d-7100-4f2c-afeb-834d930e865f req-2f66dc63-7466-40a9-8066-415effa9994f service nova] Acquiring lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:42:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f2f09b7d-7100-4f2c-afeb-834d930e865f req-2f66dc63-7466-40a9-8066-415effa9994f service nova] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:42:07 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f2f09b7d-7100-4f2c-afeb-834d930e865f req-2f66dc63-7466-40a9-8066-415effa9994f service nova] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:42:07 user nova-compute[74540]: DEBUG nova.compute.manager [req-f2f09b7d-7100-4f2c-afeb-834d930e865f req-2f66dc63-7466-40a9-8066-415effa9994f service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] No waiting events found dispatching network-vif-plugged-55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:42:07 user nova-compute[74540]: WARNING nova.compute.manager [req-f2f09b7d-7100-4f2c-afeb-834d930e865f req-2f66dc63-7466-40a9-8066-415effa9994f service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Received unexpected event network-vif-plugged-55567e31-8cb7-4203-8b47-db6d99688298 for instance with vm_state building and task_state spawning.
Nov 07 04:42:07 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:42:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:42:09 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Instance spawned successfully.
Nov 07 04:42:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:42:09 user nova-compute[74540]: INFO nova.compute.manager [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 07 04:42:09 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:42:09 user nova-compute[74540]: INFO nova.compute.manager [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Took 26.34 seconds to build instance.
Nov 07 04:42:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4f3aaea1-8016-477b-b63f-4d3179965427 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.438s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-0e97b27c-c767-45ea-a006-2b54800bb19d req-23d58cb7-e203-421e-9c0f-ba9dc07dbe02 service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Received event network-vif-plugged-55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0e97b27c-c767-45ea-a006-2b54800bb19d req-23d58cb7-e203-421e-9c0f-ba9dc07dbe02 service nova] Acquiring lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0e97b27c-c767-45ea-a006-2b54800bb19d req-23d58cb7-e203-421e-9c0f-ba9dc07dbe02 service nova] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-0e97b27c-c767-45ea-a006-2b54800bb19d req-23d58cb7-e203-421e-9c0f-ba9dc07dbe02 service nova] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:42:09 user nova-compute[74540]: DEBUG nova.compute.manager [req-0e97b27c-c767-45ea-a006-2b54800bb19d req-23d58cb7-e203-421e-9c0f-ba9dc07dbe02 service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] No waiting events found dispatching network-vif-plugged-55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:42:09 user nova-compute[74540]: WARNING nova.compute.manager [req-0e97b27c-c767-45ea-a006-2b54800bb19d req-23d58cb7-e203-421e-9c0f-ba9dc07dbe02 service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Received unexpected event network-vif-plugged-55567e31-8cb7-4203-8b47-db6d99688298 for instance with vm_state active and task_state None.
Nov 07 04:42:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:42:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:42:10 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:42:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:42:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:19 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:42:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:42:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:42:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:42:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:42:19 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:42:19 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating instance_info_cache with network_info: [{"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:42:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:42:21 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:42:21 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:42:21 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=24.80854034423828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:42:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:42:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:42:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:21 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 36935858-ea1d-4429-99b3-695ba2c26da2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:42:21 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance e2d803ae-4fa4-419e-a116-0e0c24e1953a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:42:21 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:42:21 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:42:21 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:42:21 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:42:21 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:42:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:42:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:42:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:42:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:42:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:42:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:42:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:42:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:43:00 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:43:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:43:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:43:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:43:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:05 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:43:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:43:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:43:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:43:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:08 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:10 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:43:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:43:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:12 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:13 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74540) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 04:43:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:43:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:43:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:43:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:43:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:43:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:20 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:43:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:43:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:43:20 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:43:20 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:43:20 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:21 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:43:21 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:43:21 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=24.807586669921875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 36935858-ea1d-4429-99b3-695ba2c26da2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance e2d803ae-4fa4-419e-a116-0e0c24e1953a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing inventories for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating ProviderTree inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing aggregate associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, aggregates: None {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 04:43:21 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing trait associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 04:43:22 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:43:22 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:43:22 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:43:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:43:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 04:43:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] There are 0 instances to clean {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 04:43:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:43:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:43:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:43:23 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:43:23 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updating instance_info_cache with network_info: [{"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:43:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:43:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:43:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:34 user nova-compute[74540]: DEBUG nova.compute.manager [req-396a9059-f1f1-428c-ad29-be81021cdbc9 req-7972a15f-a351-47cf-9587-f7e17d3348ba service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Received event network-changed-55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:43:34 user nova-compute[74540]: DEBUG nova.compute.manager [req-396a9059-f1f1-428c-ad29-be81021cdbc9 req-7972a15f-a351-47cf-9587-f7e17d3348ba service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Refreshing instance network info cache due to event network-changed-55567e31-8cb7-4203-8b47-db6d99688298. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:43:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-396a9059-f1f1-428c-ad29-be81021cdbc9 req-7972a15f-a351-47cf-9587-f7e17d3348ba service nova] Acquiring lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:43:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-396a9059-f1f1-428c-ad29-be81021cdbc9 req-7972a15f-a351-47cf-9587-f7e17d3348ba service nova] Acquired lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:43:34 user nova-compute[74540]: DEBUG nova.network.neutron [req-396a9059-f1f1-428c-ad29-be81021cdbc9 req-7972a15f-a351-47cf-9587-f7e17d3348ba service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Refreshing network info cache for port 55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:43:35 user nova-compute[74540]: DEBUG nova.network.neutron [req-396a9059-f1f1-428c-ad29-be81021cdbc9 req-7972a15f-a351-47cf-9587-f7e17d3348ba service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updated VIF entry in instance network info cache for port 55567e31-8cb7-4203-8b47-db6d99688298. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:43:35 user nova-compute[74540]: DEBUG nova.network.neutron [req-396a9059-f1f1-428c-ad29-be81021cdbc9 req-7972a15f-a351-47cf-9587-f7e17d3348ba service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updating instance_info_cache with network_info: [{"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:43:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-396a9059-f1f1-428c-ad29-be81021cdbc9 req-7972a15f-a351-47cf-9587-f7e17d3348ba service nova] Releasing lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:43:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:43:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:43:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:43:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:43:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:44 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:43:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:43:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid e2d803ae-4fa4-419e-a116-0e0c24e1953a {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:43:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:43:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:43:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:43:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:43:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:43:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:43:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "a5382767-ac37-4610-840b-0baa3ff2e025" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:43:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "a5382767-ac37-4610-840b-0baa3ff2e025" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:43:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:43:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:43:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:43:50 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:43:50 user nova-compute[74540]: INFO nova.compute.claims [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Claim successful on node user
Nov 07 04:43:50 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:43:50 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:43:50 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:43:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:43:50 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:43:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:43:50 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:43:50 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:43:50 user nova-compute[74540]: INFO nova.virt.block_device [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Booting with volume snapshot 9fe92ce9-284c-4e13-8ee3-2740cc04452f at /dev/vda
Nov 07 04:43:50 user nova-compute[74540]: DEBUG nova.policy [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23c9b2aeb83c4e2780c123bdb32b9dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96003f4fda04df99e4c1e37a139d0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:43:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:51 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Successfully created port: 4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:43:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Successfully updated port: 4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "refresh_cache-a5382767-ac37-4610-840b-0baa3ff2e025" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquired lock "refresh_cache-a5382767-ac37-4610-840b-0baa3ff2e025" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-22d2beea-08fa-4708-8233-f66882f703e8 req-47f4f6dd-f6e0-41ed-ab10-bec77fc64cd2 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Received event network-changed-4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG nova.compute.manager [req-22d2beea-08fa-4708-8233-f66882f703e8 req-47f4f6dd-f6e0-41ed-ab10-bec77fc64cd2 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Refreshing instance network info cache due to event network-changed-4d520338-0b06-4388-a9de-8d2464b328c7. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-22d2beea-08fa-4708-8233-f66882f703e8 req-47f4f6dd-f6e0-41ed-ab10-bec77fc64cd2 service nova] Acquiring lock "refresh_cache-a5382767-ac37-4610-840b-0baa3ff2e025" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Updating instance_info_cache with network_info: [{"id": "4d520338-0b06-4388-a9de-8d2464b328c7", "address": "fa:16:3e:dc:d1:c1", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d520338-0b", "ovs_interfaceid": "4d520338-0b06-4388-a9de-8d2464b328c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Releasing lock "refresh_cache-a5382767-ac37-4610-840b-0baa3ff2e025" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Instance network_info: |[{"id": "4d520338-0b06-4388-a9de-8d2464b328c7", "address": "fa:16:3e:dc:d1:c1", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d520338-0b", "ovs_interfaceid": "4d520338-0b06-4388-a9de-8d2464b328c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-22d2beea-08fa-4708-8233-f66882f703e8 req-47f4f6dd-f6e0-41ed-ab10-bec77fc64cd2 service nova] Acquired lock "refresh_cache-a5382767-ac37-4610-840b-0baa3ff2e025" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG nova.network.neutron [req-22d2beea-08fa-4708-8233-f66882f703e8 req-47f4f6dd-f6e0-41ed-ab10-bec77fc64cd2 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Refreshing network info cache for port 4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG nova.network.neutron [req-22d2beea-08fa-4708-8233-f66882f703e8 req-47f4f6dd-f6e0-41ed-ab10-bec77fc64cd2 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Updated VIF entry in instance network info cache for port 4d520338-0b06-4388-a9de-8d2464b328c7. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG nova.network.neutron [req-22d2beea-08fa-4708-8233-f66882f703e8 req-47f4f6dd-f6e0-41ed-ab10-bec77fc64cd2 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Updating instance_info_cache with network_info: [{"id": "4d520338-0b06-4388-a9de-8d2464b328c7", "address": "fa:16:3e:dc:d1:c1", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d520338-0b", "ovs_interfaceid": "4d520338-0b06-4388-a9de-8d2464b328c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:43:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-22d2beea-08fa-4708-8233-f66882f703e8 req-47f4f6dd-f6e0-41ed-ab10-bec77fc64cd2 service nova] Releasing lock "refresh_cache-a5382767-ac37-4610-840b-0baa3ff2e025" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG os_brick.utils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac99ad4d-77b5-4535-8a69-929b1bea4b2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0bebd8-66e8-4c35-98bf-faafcbd95050]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2915c0-e22a-4ba7-8849-28a6b765fb2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0a691a-53ba-4e40-a035-45fb589934d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:43:56 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:43:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec46c32d-4593-4ea1-85e3-474214f582f2]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG os_brick.utils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:43:56 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Updating existing volume attachment record: d502de41-3fee-44aa-afc5-8edcd33bd160 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:44:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:44:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:44:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:44:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:44:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:44:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:44:06 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:44:06 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:44:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:44:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:44:10 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:44:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:44:12 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:44:12 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:44:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:44:17 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Creating image(s)
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Ensure instance console log exists: /opt/stack/data/nova/instances/a5382767-ac37-4610-840b-0baa3ff2e025/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Start _get_guest_xml network_info=[{"id": "4d520338-0b06-4388-a9de-8d2464b328c7", "address": "fa:16:3e:dc:d1:c1", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d520338-0b", "ovs_interfaceid": "4d520338-0b06-4388-a9de-8d2464b328c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-07T04:43:36Z,direct_url=<?>,disk_format='qcow2',id=290d359a-c709-4eb3-9961-71ec26cdf932,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-920572915',owner='b96003f4fda04df99e4c1e37a139d0f1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-07T04:43:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvOaJWTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a5382767-ac37-4610-840b-0baa3ff2e025', 'attached_at': '', 'detached_at': '', 'volume_id': '69d64e15-7315-4d63-9ad6-4422d4b6b575', 'serial': '69d64e15-7315-4d63-9ad6-4422d4b6b575'}, 'boot_index': 0, 'attachment_id': 'd502de41-3fee-44aa-afc5-8edcd33bd160', 'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:44:17 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:44:17 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-07T04:43:36Z,direct_url=<?>,disk_format='qcow2',id=290d359a-c709-4eb3-9961-71ec26cdf932,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-920572915',owner='b96003f4fda04df99e4c1e37a139d0f1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-07T04:43:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvOaJWTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:44:17 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:44:17 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:44:17 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fac933-ed3d-4959-833b-5aeefe9b348a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:44:17 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[275ff9de-2ba4-49c8-9129-003bdf64e9c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575] added
Nov 07 04:44:17 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.159s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d788f1-d4ec-4630-b7ee-c74dec970b53]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.158s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ae8278-3374-4b66-a54b-e0cd984de0a8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvOaJWTK {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvOaJWTK" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[25857e89-5e17-4667-bff3-f1f567cbf837]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cvOaJWTK'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9839b61-3d04-42f3-9839-dba1d12b8eab]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac748ab9-9550-49ca-a9af-8ecaf37ba5f4]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)
Nov 07 04:44:17 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)
Nov 07 04:44:17 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:44:17 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe7d09-eca9-4ba0-b365-1e02c84c6882]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575, portal: 172.16.0.220,3260]
Nov 07 04:44:18 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575, portal: 172.16.0.220,3260] successful.
Nov 07 04:44:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b96e5b-69bf-4936-9005-c684fda4b7b8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[54489ae5-3250-4f63-a738-1728bb256982]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)
Nov 07 04:44:18 user nova-compute[74540]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 (non-flash)
Nov 07 04:44:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)
Nov 07 04:44:18 user nova-compute[74540]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 (non-flash)
Nov 07 04:44:18 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.546s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[98628e57-356a-4c06-a955-a99cdc189236]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:44:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvOaJWTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.579s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== connect_volume: return (1580ms) {'type': 'block', 'scsi_wwn': '23863336133653834', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863336133653834', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1748416624',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1748416624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1748416624',id=49,image_ref='290d359a-c709-4eb3-9961-71ec26cdf932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSOQWQikzvBLJzvTa3WbKUqe8dEJFJ3N/gXV1oIBh4vNXRgqJ2fLFFejnCz+Z3QdDqai/8kFAEo7h/joRjA1/EjP/TfFOJt8d/+aTTFXXfXW9GVCiRMPwKA/H1XKKeY8g==',key_name='tempest-keypair-1786780901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-jizdje7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-621203767',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=a5382767-ac37-4610-840b-0baa3ff2e025,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d520338-0b06-4388-a9de-8d2464b328c7", "address": "fa:16:3e:dc:d1:c1", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d520338-0b", "ovs_interfaceid": "4d520338-0b06-4388-a9de-8d2464b328c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "4d520338-0b06-4388-a9de-8d2464b328c7", "address": "fa:16:3e:dc:d1:c1", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d520338-0b", "ovs_interfaceid": "4d520338-0b06-4388-a9de-8d2464b328c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=4d520338-0b06-4388-a9de-8d2464b328c7,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d520338-0b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lazy-loading 'pci_devices' on Instance uuid a5382767-ac37-4610-840b-0baa3ff2e025 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:44:19 user nova-compute[74540]:   <uuid>a5382767-ac37-4610-840b-0baa3ff2e025</uuid>
Nov 07 04:44:19 user nova-compute[74540]:   <name>instance-00000031</name>
Nov 07 04:44:19 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:44:19 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:44:19 user nova-compute[74540]:   <metadata>
Nov 07 04:44:19 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:44:19 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:44:19 user nova-compute[74540]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1748416624</nova:name>
Nov 07 04:44:19 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:44:17</nova:creationTime>
Nov 07 04:44:19 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:44:19 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:44:19 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:44:19 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:44:19 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:44:19 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:44:19 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:44:19 user nova-compute[74540]:       <nova:owner>
Nov 07 04:44:19 user nova-compute[74540]:         <nova:user uuid="23c9b2aeb83c4e2780c123bdb32b9dde">tempest-TestVolumeBootPattern-621203767-project-member</nova:user>
Nov 07 04:44:19 user nova-compute[74540]:         <nova:project uuid="b96003f4fda04df99e4c1e37a139d0f1">tempest-TestVolumeBootPattern-621203767</nova:project>
Nov 07 04:44:19 user nova-compute[74540]:       </nova:owner>
Nov 07 04:44:19 user nova-compute[74540]:       <nova:root type="image" uuid="290d359a-c709-4eb3-9961-71ec26cdf932"/>
Nov 07 04:44:19 user nova-compute[74540]:       <nova:ports>
Nov 07 04:44:19 user nova-compute[74540]:         <nova:port uuid="4d520338-0b06-4388-a9de-8d2464b328c7">
Nov 07 04:44:19 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 07 04:44:19 user nova-compute[74540]:         </nova:port>
Nov 07 04:44:19 user nova-compute[74540]:       </nova:ports>
Nov 07 04:44:19 user nova-compute[74540]:     </nova:instance>
Nov 07 04:44:19 user nova-compute[74540]:   </metadata>
Nov 07 04:44:19 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:44:19 user nova-compute[74540]:     <system>
Nov 07 04:44:19 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:44:19 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:44:19 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:44:19 user nova-compute[74540]:       <entry name="serial">a5382767-ac37-4610-840b-0baa3ff2e025</entry>
Nov 07 04:44:19 user nova-compute[74540]:       <entry name="uuid">a5382767-ac37-4610-840b-0baa3ff2e025</entry>
Nov 07 04:44:19 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:44:19 user nova-compute[74540]:     </system>
Nov 07 04:44:19 user nova-compute[74540]:   </sysinfo>
Nov 07 04:44:19 user nova-compute[74540]:   <os>
Nov 07 04:44:19 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:44:19 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:44:19 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:44:19 user nova-compute[74540]:   </os>
Nov 07 04:44:19 user nova-compute[74540]:   <features>
Nov 07 04:44:19 user nova-compute[74540]:     <acpi/>
Nov 07 04:44:19 user nova-compute[74540]:     <apic/>
Nov 07 04:44:19 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:44:19 user nova-compute[74540]:   </features>
Nov 07 04:44:19 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:44:19 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:44:19 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:44:19 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:44:19 user nova-compute[74540]:   </clock>
Nov 07 04:44:19 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:44:19 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:44:19 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:44:19 user nova-compute[74540]:   </cpu>
Nov 07 04:44:19 user nova-compute[74540]:   <devices>
Nov 07 04:44:19 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:44:19 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:44:19 user nova-compute[74540]:       <source dev="/dev/sdc"/>
Nov 07 04:44:19 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:44:19 user nova-compute[74540]:       <serial>69d64e15-7315-4d63-9ad6-4422d4b6b575</serial>
Nov 07 04:44:19 user nova-compute[74540]:     </disk>
Nov 07 04:44:19 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:44:19 user nova-compute[74540]:       <mac address="fa:16:3e:dc:d1:c1"/>
Nov 07 04:44:19 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:44:19 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:44:19 user nova-compute[74540]:       <target dev="tap4d520338-0b"/>
Nov 07 04:44:19 user nova-compute[74540]:     </interface>
Nov 07 04:44:19 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:44:19 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/a5382767-ac37-4610-840b-0baa3ff2e025/console.log" append="off"/>
Nov 07 04:44:19 user nova-compute[74540]:     </serial>
Nov 07 04:44:19 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:44:19 user nova-compute[74540]:     <video>
Nov 07 04:44:19 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:44:19 user nova-compute[74540]:     </video>
Nov 07 04:44:19 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:44:19 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:44:19 user nova-compute[74540]:     </rng>
Nov 07 04:44:19 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:44:19 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:44:19 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:44:19 user nova-compute[74540]:     </memballoon>
Nov 07 04:44:19 user nova-compute[74540]:   </devices>
Nov 07 04:44:19 user nova-compute[74540]: </domain>
Nov 07 04:44:19 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1748416624',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1748416624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1748416624',id=49,image_ref='290d359a-c709-4eb3-9961-71ec26cdf932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSOQWQikzvBLJzvTa3WbKUqe8dEJFJ3N/gXV1oIBh4vNXRgqJ2fLFFejnCz+Z3QdDqai/8kFAEo7h/joRjA1/EjP/TfFOJt8d/+aTTFXXfXW9GVCiRMPwKA/H1XKKeY8g==',key_name='tempest-keypair-1786780901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-jizdje7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-621203767',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=a5382767-ac37-4610-840b-0baa3ff2e025,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d520338-0b06-4388-a9de-8d2464b328c7", "address": "fa:16:3e:dc:d1:c1", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d520338-0b", "ovs_interfaceid": "4d520338-0b06-4388-a9de-8d2464b328c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "4d520338-0b06-4388-a9de-8d2464b328c7", "address": "fa:16:3e:dc:d1:c1", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d520338-0b", "ovs_interfaceid": "4d520338-0b06-4388-a9de-8d2464b328c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=4d520338-0b06-4388-a9de-8d2464b328c7,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d520338-0b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG os_vif [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=4d520338-0b06-4388-a9de-8d2464b328c7,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d520338-0b') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cf6097e-5538-5310-a9d5-6437da506a88', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d520338-0b, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d520338-0b, col_values=(('qos', UUID('ecdaf314-5d32-4ccc-ad13-1c3e1af8b533')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d520338-0b, col_values=(('external_ids', {'iface-id': '4d520338-0b06-4388-a9de-8d2464b328c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:d1:c1', 'vm-uuid': 'a5382767-ac37-4610-840b-0baa3ff2e025'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:19 user nova-compute[74540]: INFO os_vif [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=4d520338-0b06-4388-a9de-8d2464b328c7,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d520338-0b')
Nov 07 04:44:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:44:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] No VIF found with MAC fa:16:3e:dc:d1:c1, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:44:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:20 user nova-compute[74540]: DEBUG nova.compute.manager [req-8c21d94d-5150-4abb-9f75-d2dca5995202 req-c31ab0a1-d5f3-4243-b045-ebf97cd760f8 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Received event network-vif-plugged-4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:44:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8c21d94d-5150-4abb-9f75-d2dca5995202 req-c31ab0a1-d5f3-4243-b045-ebf97cd760f8 service nova] Acquiring lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:44:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8c21d94d-5150-4abb-9f75-d2dca5995202 req-c31ab0a1-d5f3-4243-b045-ebf97cd760f8 service nova] Lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:44:20 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8c21d94d-5150-4abb-9f75-d2dca5995202 req-c31ab0a1-d5f3-4243-b045-ebf97cd760f8 service nova] Lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:44:20 user nova-compute[74540]: DEBUG nova.compute.manager [req-8c21d94d-5150-4abb-9f75-d2dca5995202 req-c31ab0a1-d5f3-4243-b045-ebf97cd760f8 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] No waiting events found dispatching network-vif-plugged-4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:44:20 user nova-compute[74540]: WARNING nova.compute.manager [req-8c21d94d-5150-4abb-9f75-d2dca5995202 req-c31ab0a1-d5f3-4243-b045-ebf97cd760f8 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Received unexpected event network-vif-plugged-4d520338-0b06-4388-a9de-8d2464b328c7 for instance with vm_state building and task_state spawning.
Nov 07 04:44:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:21 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:44:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:44:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:44:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Skipping network cache update for instance because it is Building. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 07 04:44:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:44:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:44:21 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:44:21 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating instance_info_cache with network_info: [{"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-36935858-ea1d-4429-99b3-695ba2c26da2" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:44:22 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Instance spawned successfully.
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:44:22 user nova-compute[74540]: INFO nova.compute.manager [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-bdf4aaae-2376-4faa-bfbf-dca2be31cb80 req-e946035c-568c-45f3-8b93-f73d51a95c9d service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Received event network-vif-plugged-4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bdf4aaae-2376-4faa-bfbf-dca2be31cb80 req-e946035c-568c-45f3-8b93-f73d51a95c9d service nova] Acquiring lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bdf4aaae-2376-4faa-bfbf-dca2be31cb80 req-e946035c-568c-45f3-8b93-f73d51a95c9d service nova] Lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-bdf4aaae-2376-4faa-bfbf-dca2be31cb80 req-e946035c-568c-45f3-8b93-f73d51a95c9d service nova] Lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.compute.manager [req-bdf4aaae-2376-4faa-bfbf-dca2be31cb80 req-e946035c-568c-45f3-8b93-f73d51a95c9d service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] No waiting events found dispatching network-vif-plugged-4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:44:22 user nova-compute[74540]: WARNING nova.compute.manager [req-bdf4aaae-2376-4faa-bfbf-dca2be31cb80 req-e946035c-568c-45f3-8b93-f73d51a95c9d service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Received unexpected event network-vif-plugged-4d520338-0b06-4388-a9de-8d2464b328c7 for instance with vm_state building and task_state spawning.
Nov 07 04:44:22 user nova-compute[74540]: INFO nova.compute.manager [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Took 32.77 seconds to build instance.
Nov 07 04:44:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e7505d29-6d6e-467f-9301-b9ed4bc7cec8 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "a5382767-ac37-4610-840b-0baa3ff2e025" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.900s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:44:22 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:44:23 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:44:23 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:44:23 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=24.80512237548828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 36935858-ea1d-4429-99b3-695ba2c26da2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance e2d803ae-4fa4-419e-a116-0e0c24e1953a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a5382767-ac37-4610-840b-0baa3ff2e025 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:44:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:44:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:44:39 user nova-compute[74540]: INFO nova.compute.manager [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Terminating instance
Nov 07 04:44:39 user nova-compute[74540]: DEBUG nova.compute.manager [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-e12e7750-030a-4727-b02d-a4541e10082e req-ff67ce02-97aa-445d-b827-ec1cb563924f service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Received event network-vif-unplugged-6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e12e7750-030a-4727-b02d-a4541e10082e req-ff67ce02-97aa-445d-b827-ec1cb563924f service nova] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e12e7750-030a-4727-b02d-a4541e10082e req-ff67ce02-97aa-445d-b827-ec1cb563924f service nova] Lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e12e7750-030a-4727-b02d-a4541e10082e req-ff67ce02-97aa-445d-b827-ec1cb563924f service nova] Lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-e12e7750-030a-4727-b02d-a4541e10082e req-ff67ce02-97aa-445d-b827-ec1cb563924f service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] No waiting events found dispatching network-vif-unplugged-6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:44:39 user nova-compute[74540]: DEBUG nova.compute.manager [req-e12e7750-030a-4727-b02d-a4541e10082e req-ff67ce02-97aa-445d-b827-ec1cb563924f service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Received event network-vif-unplugged-6764e6c7-a016-4744-b2c1-ff4867806453 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:40 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Instance destroyed successfully.
Nov 07 04:44:40 user nova-compute[74540]: DEBUG nova.objects.instance [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lazy-loading 'resources' on Instance uuid 36935858-ea1d-4429-99b3-695ba2c26da2 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:33:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1315715253',display_name='tempest-SnapshotDataIntegrityTests-server-1315715253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1315715253',id=46,image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQSOc7s57WzA+ddSzylftpiSd97FZWn7yildFc8h985H2T0wlwS3jYpAYOLZlqKa17eoSXeL//d7WoMfwlvFnOOGeMqQ9+0zcUce3giVqP/qsPg3RLiyLWpGel/uf4e7A==',key_name='tempest-keypair-1222380731',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:33:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa45bac848334cb3b27d251ce793739f',ramdisk_id='',reservation_id='r-xx95rsce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b2fc4ee2-830c-4852-b2e5-8dcdd33e1718',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1803413608',owner_user_name='tempest-SnapshotDataIntegrityTests-1803413608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:33:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55a21121d30244e98c7da566ca5a4605',uuid=36935858-ea1d-4429-99b3-695ba2c26da2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Converting VIF {"id": "6764e6c7-a016-4744-b2c1-ff4867806453", "address": "fa:16:3e:91:3a:5c", "network": {"id": "293f37c8-022e-4416-ab1d-216fefec2719", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-274254604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa45bac848334cb3b27d251ce793739f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764e6c7-a0", "ovs_interfaceid": "6764e6c7-a016-4744-b2c1-ff4867806453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=6764e6c7-a016-4744-b2c1-ff4867806453,network=Network(293f37c8-022e-4416-ab1d-216fefec2719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764e6c7-a0') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG os_vif [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=6764e6c7-a016-4744-b2c1-ff4867806453,network=Network(293f37c8-022e-4416-ab1d-216fefec2719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764e6c7-a0') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6764e6c7-a0, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7abd64e5-0a40-45a1-bab0-e2864c453b25) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:44:40 user nova-compute[74540]: INFO os_vif [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:3a:5c,bridge_name='br-int',has_traffic_filtering=True,id=6764e6c7-a016-4744-b2c1-ff4867806453,network=Network(293f37c8-022e-4416-ab1d-216fefec2719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764e6c7-a0')
Nov 07 04:44:40 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Deleting instance files /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2_del
Nov 07 04:44:40 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Deletion of /opt/stack/data/nova/instances/36935858-ea1d-4429-99b3-695ba2c26da2_del complete
Nov 07 04:44:40 user nova-compute[74540]: INFO nova.compute.manager [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 07 04:44:40 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:44:40 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:44:41 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:44:41 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Took 1.21 seconds to deallocate network for instance.
Nov 07 04:44:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:44:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:44:41 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:44:41 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:44:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:44:41 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Deleted allocations for instance 36935858-ea1d-4429-99b3-695ba2c26da2
Nov 07 04:44:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-cc804cca-c0b4-4809-adbb-c41bdf431f7d req-efb127e6-f744-4c56-b4c2-baa5d6d8523a service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Received event network-vif-plugged-6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:44:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-cc804cca-c0b4-4809-adbb-c41bdf431f7d req-efb127e6-f744-4c56-b4c2-baa5d6d8523a service nova] Acquiring lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:44:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-cc804cca-c0b4-4809-adbb-c41bdf431f7d req-efb127e6-f744-4c56-b4c2-baa5d6d8523a service nova] Lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:44:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-cc804cca-c0b4-4809-adbb-c41bdf431f7d req-efb127e6-f744-4c56-b4c2-baa5d6d8523a service nova] Lock "36935858-ea1d-4429-99b3-695ba2c26da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:44:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-cc804cca-c0b4-4809-adbb-c41bdf431f7d req-efb127e6-f744-4c56-b4c2-baa5d6d8523a service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] No waiting events found dispatching network-vif-plugged-6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:44:41 user nova-compute[74540]: WARNING nova.compute.manager [req-cc804cca-c0b4-4809-adbb-c41bdf431f7d req-efb127e6-f744-4c56-b4c2-baa5d6d8523a service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Received unexpected event network-vif-plugged-6764e6c7-a016-4744-b2c1-ff4867806453 for instance with vm_state deleted and task_state None.
Nov 07 04:44:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-cc804cca-c0b4-4809-adbb-c41bdf431f7d req-efb127e6-f744-4c56-b4c2-baa5d6d8523a service nova] [instance: 36935858-ea1d-4429-99b3-695ba2c26da2] Received event network-vif-deleted-6764e6c7-a016-4744-b2c1-ff4867806453 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:44:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-a0470394-84d2-4c7e-be99-83a8dd61dbd0 tempest-SnapshotDataIntegrityTests-1803413608 tempest-SnapshotDataIntegrityTests-1803413608-project-member] Lock "36935858-ea1d-4429-99b3-695ba2c26da2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.533s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:44:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:44:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:45:07 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:45:07 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:45:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:45:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:45:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:45:11 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:45:12 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:45:13 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:45:13 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:45:13 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:45:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:45:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:45:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:45:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:45:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:45:22 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:45:22 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:45:23 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updating instance_info_cache with network_info: [{"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:45:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:45:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:45:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:45:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:45:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:45:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:45:24 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:45:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:45:24 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:45:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:25 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:45:25 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:45:25 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=24.832275390625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:45:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:45:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:45:25 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance e2d803ae-4fa4-419e-a116-0e0c24e1953a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:45:25 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a5382767-ac37-4610-840b-0baa3ff2e025 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:45:25 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:45:25 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:45:25 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:45:25 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:45:25 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:45:25 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:45:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-65f2457d-d23a-4429-ad0f-69860b3ef3c0 req-c73d082d-06ec-488b-988e-aa5fff227ff6 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Received event network-changed-4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG nova.compute.manager [req-65f2457d-d23a-4429-ad0f-69860b3ef3c0 req-c73d082d-06ec-488b-988e-aa5fff227ff6 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Refreshing instance network info cache due to event network-changed-4d520338-0b06-4388-a9de-8d2464b328c7. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-65f2457d-d23a-4429-ad0f-69860b3ef3c0 req-c73d082d-06ec-488b-988e-aa5fff227ff6 service nova] Acquiring lock "refresh_cache-a5382767-ac37-4610-840b-0baa3ff2e025" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-65f2457d-d23a-4429-ad0f-69860b3ef3c0 req-c73d082d-06ec-488b-988e-aa5fff227ff6 service nova] Acquired lock "refresh_cache-a5382767-ac37-4610-840b-0baa3ff2e025" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-65f2457d-d23a-4429-ad0f-69860b3ef3c0 req-c73d082d-06ec-488b-988e-aa5fff227ff6 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Refreshing network info cache for port 4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-65f2457d-d23a-4429-ad0f-69860b3ef3c0 req-c73d082d-06ec-488b-988e-aa5fff227ff6 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Updated VIF entry in instance network info cache for port 4d520338-0b06-4388-a9de-8d2464b328c7. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG nova.network.neutron [req-65f2457d-d23a-4429-ad0f-69860b3ef3c0 req-c73d082d-06ec-488b-988e-aa5fff227ff6 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Updating instance_info_cache with network_info: [{"id": "4d520338-0b06-4388-a9de-8d2464b328c7", "address": "fa:16:3e:dc:d1:c1", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d520338-0b", "ovs_interfaceid": "4d520338-0b06-4388-a9de-8d2464b328c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-65f2457d-d23a-4429-ad0f-69860b3ef3c0 req-c73d082d-06ec-488b-988e-aa5fff227ff6 service nova] Releasing lock "refresh_cache-a5382767-ac37-4610-840b-0baa3ff2e025" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "a5382767-ac37-4610-840b-0baa3ff2e025" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "a5382767-ac37-4610-840b-0baa3ff2e025" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:45:41 user nova-compute[74540]: INFO nova.compute.manager [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Terminating instance
Nov 07 04:45:41 user nova-compute[74540]: DEBUG nova.compute.manager [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Instance destroyed successfully.
Nov 07 04:45:42 user nova-compute[74540]: DEBUG nova.objects.instance [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lazy-loading 'resources' on Instance uuid a5382767-ac37-4610-840b-0baa3ff2e025 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1748416624',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1748416624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1748416624',id=49,image_ref='290d359a-c709-4eb3-9961-71ec26cdf932',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSOQWQikzvBLJzvTa3WbKUqe8dEJFJ3N/gXV1oIBh4vNXRgqJ2fLFFejnCz+Z3QdDqai/8kFAEo7h/joRjA1/EjP/TfFOJt8d/+aTTFXXfXW9GVCiRMPwKA/H1XKKeY8g==',key_name='tempest-keypair-1786780901',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-jizdje7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-621203767',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=a5382767-ac37-4610-840b-0baa3ff2e025,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d520338-0b06-4388-a9de-8d2464b328c7", "address": "fa:16:3e:dc:d1:c1", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d520338-0b", "ovs_interfaceid": "4d520338-0b06-4388-a9de-8d2464b328c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "4d520338-0b06-4388-a9de-8d2464b328c7", "address": "fa:16:3e:dc:d1:c1", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d520338-0b", "ovs_interfaceid": "4d520338-0b06-4388-a9de-8d2464b328c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=4d520338-0b06-4388-a9de-8d2464b328c7,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d520338-0b') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_vif [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=4d520338-0b06-4388-a9de-8d2464b328c7,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d520338-0b') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d520338-0b, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecdaf314-5d32-4ccc-ad13-1c3e1af8b533) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:45:42 user nova-compute[74540]: INFO os_vif [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:d1:c1,bridge_name='br-int',has_traffic_filtering=True,id=4d520338-0b06-4388-a9de-8d2464b328c7,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d520338-0b')
Nov 07 04:45:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvOaJWTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:45:42 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7129e4dd-43cb-4444-8e0a-a988f27b384f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:45:42 user nova-compute[74540]: No targets found.
Nov 07 04:45:42 user nova-compute[74540]: iSNS:
Nov 07 04:45:42 user nova-compute[74540]: No targets found.
Nov 07 04:45:42 user nova-compute[74540]: STATIC:
Nov 07 04:45:42 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7
Nov 07 04:45:42 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:45:42 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:45:42 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575
Nov 07 04:45:42 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:45:42 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:45:42 user nova-compute[74540]: FIRMWARE:
Nov 07 04:45:42 user nova-compute[74540]: No targets found.
Nov 07 04:45:42 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:45:42 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:45:42 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aed279-2993-48d1-9531-d8b47bbad391]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[021f12d6-3eb7-4bb2-9543-80536dd0c8f1]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)
Nov 07 04:45:42 user nova-compute[74540]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 (non-flash)
Nov 07 04:45:42 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)
Nov 07 04:45:42 user nova-compute[74540]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 (non-flash)
Nov 07 04:45:42 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc39e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b1f22d-0ab8-469d-b8f6-1a81d9955341]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3fcc94-0771-4126-9e0f-24c14db55055]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[425a9810-097c-4a59-99fc-9c048c3e519c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33c702c-01b1-49fe-ba30-3525328de090]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd7c5e698-8c3a3e84bad2feb7', '/dev/disk/by-id/scsi-23863336133653834', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d7c5e698') {{(pid=85868) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 07 04:45:42 user nova-compute[74540]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOd7c5e698-8c3a3e84bad2feb7
Nov 07 04:45:42 user nova-compute[74540]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23863336133653834
Nov 07 04:45:42 user nova-compute[74540]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_d7c5e698
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b6c270-024e-4b49-9d8e-fc2804872133]: (4, None) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47e9617-3b6b-4e5c-ae2e-1049e357758a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c7047c-e981-4cdb-9275-6ba396d31c76]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575, portal: 172.16.0.220,3260]
Nov 07 04:45:42 user nova-compute[74540]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575, portal: 172.16.0.220,3260] successful.
Nov 07 04:45:42 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69d64e15-7315-4d63-9ad6-4422d4b6b575 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[015ef529-ce16-48a5-8e15-179000316934]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== disconnect_volume: return (352ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:45:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Deleting instance files /opt/stack/data/nova/instances/a5382767-ac37-4610-840b-0baa3ff2e025_del
Nov 07 04:45:42 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Deletion of /opt/stack/data/nova/instances/a5382767-ac37-4610-840b-0baa3ff2e025_del complete
Nov 07 04:45:42 user nova-compute[74540]: INFO nova.compute.manager [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 07 04:45:42 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:45:42 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:45:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-b609c51b-ac4b-4179-813c-6263b4b7949e req-99158ae4-9de3-47b6-a934-2f8f6aaa3368 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Received event network-vif-unplugged-4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:45:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b609c51b-ac4b-4179-813c-6263b4b7949e req-99158ae4-9de3-47b6-a934-2f8f6aaa3368 service nova] Acquiring lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:45:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b609c51b-ac4b-4179-813c-6263b4b7949e req-99158ae4-9de3-47b6-a934-2f8f6aaa3368 service nova] Lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:45:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b609c51b-ac4b-4179-813c-6263b4b7949e req-99158ae4-9de3-47b6-a934-2f8f6aaa3368 service nova] Lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:45:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-b609c51b-ac4b-4179-813c-6263b4b7949e req-99158ae4-9de3-47b6-a934-2f8f6aaa3368 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] No waiting events found dispatching network-vif-unplugged-4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:45:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-b609c51b-ac4b-4179-813c-6263b4b7949e req-99158ae4-9de3-47b6-a934-2f8f6aaa3368 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Received event network-vif-unplugged-4d520338-0b06-4388-a9de-8d2464b328c7 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:45:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-b609c51b-ac4b-4179-813c-6263b4b7949e req-99158ae4-9de3-47b6-a934-2f8f6aaa3368 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Received event network-vif-plugged-4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:45:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b609c51b-ac4b-4179-813c-6263b4b7949e req-99158ae4-9de3-47b6-a934-2f8f6aaa3368 service nova] Acquiring lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:45:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b609c51b-ac4b-4179-813c-6263b4b7949e req-99158ae4-9de3-47b6-a934-2f8f6aaa3368 service nova] Lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:45:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-b609c51b-ac4b-4179-813c-6263b4b7949e req-99158ae4-9de3-47b6-a934-2f8f6aaa3368 service nova] Lock "a5382767-ac37-4610-840b-0baa3ff2e025-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:45:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-b609c51b-ac4b-4179-813c-6263b4b7949e req-99158ae4-9de3-47b6-a934-2f8f6aaa3368 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] No waiting events found dispatching network-vif-plugged-4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:45:43 user nova-compute[74540]: WARNING nova.compute.manager [req-b609c51b-ac4b-4179-813c-6263b4b7949e req-99158ae4-9de3-47b6-a934-2f8f6aaa3368 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Received unexpected event network-vif-plugged-4d520338-0b06-4388-a9de-8d2464b328c7 for instance with vm_state active and task_state deleting.
Nov 07 04:45:43 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:45:43 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Took 0.69 seconds to deallocate network for instance.
Nov 07 04:45:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-2340d334-31e7-4787-9b13-4fcae4ad2580 req-12a3e159-4904-4ba6-bea6-554b0fc16b34 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Received event network-vif-deleted-4d520338-0b06-4388-a9de-8d2464b328c7 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:45:43 user nova-compute[74540]: INFO nova.compute.manager [req-2340d334-31e7-4787-9b13-4fcae4ad2580 req-12a3e159-4904-4ba6-bea6-554b0fc16b34 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Neutron deleted interface 4d520338-0b06-4388-a9de-8d2464b328c7; detaching it from the instance and deleting it from the info cache
Nov 07 04:45:43 user nova-compute[74540]: DEBUG nova.network.neutron [req-2340d334-31e7-4787-9b13-4fcae4ad2580 req-12a3e159-4904-4ba6-bea6-554b0fc16b34 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:45:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-2340d334-31e7-4787-9b13-4fcae4ad2580 req-12a3e159-4904-4ba6-bea6-554b0fc16b34 service nova] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Detach interface failed, port_id=4d520338-0b06-4388-a9de-8d2464b328c7, reason: Instance a5382767-ac37-4610-840b-0baa3ff2e025 could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:45:44 user nova-compute[74540]: INFO nova.compute.manager [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Took 0.99 seconds to detach 1 volumes for instance.
Nov 07 04:45:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a5382767-ac37-4610-840b-0baa3ff2e025] Deleting volume: 69d64e15-7315-4d63-9ad6-4422d4b6b575 {{(pid=74540) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 07 04:45:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:45:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:45:44 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:45:44 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:45:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:45:44 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Deleted allocations for instance a5382767-ac37-4610-840b-0baa3ff2e025
Nov 07 04:45:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-d44b2656-4c1e-4e78-8c0f-f4f18b6a2e1f tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "a5382767-ac37-4610-840b-0baa3ff2e025" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.282s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:45:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:45:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:46:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:07 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:46:08 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:46:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:46:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:46:12 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:46:12 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:46:12 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:46:14 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:46:14 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:46:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:46:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:46:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:46:23 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:46:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:46:23 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:46:23 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:46:23 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid e2d803ae-4fa4-419e-a116-0e0c24e1953a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:46:24 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updating instance_info_cache with network_info: [{"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:46:24 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-e2d803ae-4fa4-419e-a116-0e0c24e1953a" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:46:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:46:26 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:46:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:46:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:46:26 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:46:26 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:46:26 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:46:27 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:46:27 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:46:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=24.828388214111328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance e2d803ae-4fa4-419e-a116-0e0c24e1953a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:46:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:46:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:46:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:46:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:46:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:46:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:46:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:46:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:46:42 user nova-compute[74540]: INFO nova.compute.manager [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Terminating instance
Nov 07 04:46:42 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:46:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-e308d927-2d2b-48a0-beed-68f4eddf7849 req-9e20382b-7319-4f00-bf63-89d38717d1ff service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Received event network-vif-unplugged-55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e308d927-2d2b-48a0-beed-68f4eddf7849 req-9e20382b-7319-4f00-bf63-89d38717d1ff service nova] Acquiring lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e308d927-2d2b-48a0-beed-68f4eddf7849 req-9e20382b-7319-4f00-bf63-89d38717d1ff service nova] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e308d927-2d2b-48a0-beed-68f4eddf7849 req-9e20382b-7319-4f00-bf63-89d38717d1ff service nova] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-e308d927-2d2b-48a0-beed-68f4eddf7849 req-9e20382b-7319-4f00-bf63-89d38717d1ff service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] No waiting events found dispatching network-vif-unplugged-55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-e308d927-2d2b-48a0-beed-68f4eddf7849 req-9e20382b-7319-4f00-bf63-89d38717d1ff service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Received event network-vif-unplugged-55567e31-8cb7-4203-8b47-db6d99688298 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:43 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Instance destroyed successfully.
Nov 07 04:46:43 user nova-compute[74540]: DEBUG nova.objects.instance [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lazy-loading 'resources' on Instance uuid e2d803ae-4fa4-419e-a116-0e0c24e1953a {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:41:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-817994443',display_name='tempest-TestVolumeBootPattern-volume-backed-server-817994443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-817994443',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDP1a40xg/q/dwuKW5aFbb3cs5XM9BU5IIw/UFhoy63crgYewR/n8ecBPPmJRZa53o6Uy5CoGwWB0skMvCRALlTxlEEjQBGXYe1oB0tJrGqbTLzwhz0nVSJnR+59TRPjNg==',key_name='tempest-keypair-1958101681',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:42:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-4o8ga1gz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=e2d803ae-4fa4-419e-a116-0e0c24e1953a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "55567e31-8cb7-4203-8b47-db6d99688298", "address": "fa:16:3e:0d:ef:d3", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55567e31-8c", "ovs_interfaceid": "55567e31-8cb7-4203-8b47-db6d99688298", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ef:d3,bridge_name='br-int',has_traffic_filtering=True,id=55567e31-8cb7-4203-8b47-db6d99688298,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55567e31-8c') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_vif [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ef:d3,bridge_name='br-int',has_traffic_filtering=True,id=55567e31-8cb7-4203-8b47-db6d99688298,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55567e31-8c') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55567e31-8c, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=099041da-3873-4bd7-883a-b2c0510ceedf) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:46:43 user nova-compute[74540]: INFO os_vif [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:ef:d3,bridge_name='br-int',has_traffic_filtering=True,id=55567e31-8cb7-4203-8b47-db6d99688298,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55567e31-8c')
Nov 07 04:46:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqkEyVUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:46:43 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ab7d30-910b-4549-a671-ce36e4224c8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:46:43 user nova-compute[74540]: No targets found.
Nov 07 04:46:43 user nova-compute[74540]: iSNS:
Nov 07 04:46:43 user nova-compute[74540]: No targets found.
Nov 07 04:46:43 user nova-compute[74540]: STATIC:
Nov 07 04:46:43 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7
Nov 07 04:46:43 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:46:43 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:46:43 user nova-compute[74540]: FIRMWARE:
Nov 07 04:46:43 user nova-compute[74540]: No targets found.
Nov 07 04:46:43 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:46:43 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:46:43 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01fadc5-c3f6-4f96-979c-edbf08d84691]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9866fdcb-37b2-4b65-9c35-ed4916855979]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)
Nov 07 04:46:43 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 (non-flash)
Nov 07 04:46:43 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedd86669e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cc11ad-69d7-4b0a-aeee-6ed5c8a18245]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05bb6c6-11f5-4842-bf64-95151534db8b]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d95e0ca-813b-4f37-bf54-a0cd7b9691b3]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65f1bbd-88c3-41e3-a54f-f3d5417c7cf0]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23465643837613661', '/dev/disk/by-id/scsi-1SCST_BIO7c76b34d-4ed87a6a38d7f5ab', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7c76b34d') {{(pid=85868) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e53a61-6a3e-48bd-85cb-41d6eed7bb17]: (4, None) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e09cc0-8090-4591-ac78-0c4e9bc9fc47]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47bdbdf-8121-46db-8fc7-2791e83b8592]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7, portal: 172.16.0.220,3260]
Nov 07 04:46:43 user nova-compute[74540]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7, portal: 172.16.0.220,3260] successful.
Nov 07 04:46:43 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc1d39b-f25e-4b24-976c-6c32e1f9de78]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== disconnect_volume: return (300ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:46:43 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Deleting instance files /opt/stack/data/nova/instances/e2d803ae-4fa4-419e-a116-0e0c24e1953a_del
Nov 07 04:46:43 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Deletion of /opt/stack/data/nova/instances/e2d803ae-4fa4-419e-a116-0e0c24e1953a_del complete
Nov 07 04:46:43 user nova-compute[74540]: INFO nova.compute.manager [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 07 04:46:43 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:46:43 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:46:44 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:46:44 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Took 0.90 seconds to deallocate network for instance.
Nov 07 04:46:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-c8ea9aed-5d93-456c-b4df-8011c01bcf47 req-cebd7d0b-d43e-4c6d-a47d-c60921e03b02 service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Received event network-vif-deleted-55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:46:44 user nova-compute[74540]: INFO nova.compute.manager [req-c8ea9aed-5d93-456c-b4df-8011c01bcf47 req-cebd7d0b-d43e-4c6d-a47d-c60921e03b02 service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Neutron deleted interface 55567e31-8cb7-4203-8b47-db6d99688298; detaching it from the instance and deleting it from the info cache
Nov 07 04:46:44 user nova-compute[74540]: DEBUG nova.network.neutron [req-c8ea9aed-5d93-456c-b4df-8011c01bcf47 req-cebd7d0b-d43e-4c6d-a47d-c60921e03b02 service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:46:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-c8ea9aed-5d93-456c-b4df-8011c01bcf47 req-cebd7d0b-d43e-4c6d-a47d-c60921e03b02 service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Detach interface failed, port_id=55567e31-8cb7-4203-8b47-db6d99688298, reason: Instance e2d803ae-4fa4-419e-a116-0e0c24e1953a could not be found. {{(pid=74540) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 07 04:46:45 user nova-compute[74540]: DEBUG nova.compute.manager [req-13bd4f97-23bc-4260-a509-4977f550e8c2 req-f6fc68d6-ad94-4f33-a264-11b38208c41d service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Received event network-vif-plugged-55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:46:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-13bd4f97-23bc-4260-a509-4977f550e8c2 req-f6fc68d6-ad94-4f33-a264-11b38208c41d service nova] Acquiring lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:46:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-13bd4f97-23bc-4260-a509-4977f550e8c2 req-f6fc68d6-ad94-4f33-a264-11b38208c41d service nova] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:46:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-13bd4f97-23bc-4260-a509-4977f550e8c2 req-f6fc68d6-ad94-4f33-a264-11b38208c41d service nova] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:46:45 user nova-compute[74540]: DEBUG nova.compute.manager [req-13bd4f97-23bc-4260-a509-4977f550e8c2 req-f6fc68d6-ad94-4f33-a264-11b38208c41d service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] No waiting events found dispatching network-vif-plugged-55567e31-8cb7-4203-8b47-db6d99688298 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:46:45 user nova-compute[74540]: WARNING nova.compute.manager [req-13bd4f97-23bc-4260-a509-4977f550e8c2 req-f6fc68d6-ad94-4f33-a264-11b38208c41d service nova] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Received unexpected event network-vif-plugged-55567e31-8cb7-4203-8b47-db6d99688298 for instance with vm_state active and task_state deleting.
Nov 07 04:46:45 user nova-compute[74540]: INFO nova.compute.manager [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Took 0.84 seconds to detach 1 volumes for instance.
Nov 07 04:46:45 user nova-compute[74540]: DEBUG nova.compute.manager [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: e2d803ae-4fa4-419e-a116-0e0c24e1953a] Deleting volume: b0dea0f5-abaa-4c7d-b9ad-189c6b0293d7 {{(pid=74540) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 07 04:46:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:46:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:46:45 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:46:45 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:46:45 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:46:45 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Deleted allocations for instance e2d803ae-4fa4-419e-a116-0e0c24e1953a
Nov 07 04:46:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-4c449e81-3296-46ac-941f-e25f8b3c5c56 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "e2d803ae-4fa4-419e-a116-0e0c24e1953a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.262s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:46:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:46:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:46:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:46:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:46:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:46:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:47:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:47:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:47:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:47:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:47:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:09 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:47:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:47:11 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:47:12 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:47:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:47:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:47:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:47:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:47:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:13 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:47:13 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:47:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:47:15 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:47:16 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:47:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:47:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:47:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:47:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:47:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:47:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:47:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:47:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:47:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:25 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:47:25 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:47:25 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:47:25 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 04:47:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:28 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:47:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:47:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:47:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:47:28 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:47:29 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:47:29 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:47:29 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=9138MB free_disk=24.827518463134766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:47:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:47:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:47:29 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:47:29 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:47:29 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:47:29 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:47:29 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:47:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:47:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:47:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:47:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:47:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:47:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "42d49781-e408-42a8-a388-ca1770c1bbfb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:47:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:47:55 user nova-compute[74540]: DEBUG nova.compute.manager [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:47:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:47:55 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:47:55 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:47:55 user nova-compute[74540]: INFO nova.compute.claims [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Claim successful on node user
Nov 07 04:47:55 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG nova.network.neutron [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:47:56 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:47:56 user nova-compute[74540]: DEBUG nova.compute.manager [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:47:56 user nova-compute[74540]: INFO nova.virt.block_device [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Booting with volume 3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 at /dev/vda
Nov 07 04:47:56 user nova-compute[74540]: DEBUG nova.policy [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23c9b2aeb83c4e2780c123bdb32b9dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96003f4fda04df99e4c1e37a139d0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG os_brick.utils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ca13eb-fd29-4241-b72e-bcde09207139]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6aca76-e940-4718-bed4-e640033213ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2fedd7-aa53-47ce-a650-172625e52b31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dfa783-6d7f-44cf-94e1-31c4ada05efd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:47:56 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:47:56 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5a1b86-a4bc-4fcb-bd95-da684ed66bfd]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG os_brick.utils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:47:56 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Updating existing volume attachment record: 876e0dfd-d523-4d1e-aa08-f62e8c685578 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:47:57 user nova-compute[74540]: DEBUG nova.network.neutron [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Successfully created port: 5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Successfully updated port: 5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquired lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-5084064a-47ae-49d3-b789-abc6df737bae req-2d1b39f8-4805-4b56-9f2b-8bba30d9bfdd service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Received event network-changed-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-5084064a-47ae-49d3-b789-abc6df737bae req-2d1b39f8-4805-4b56-9f2b-8bba30d9bfdd service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Refreshing instance network info cache due to event network-changed-5122df04-3e5c-4a22-9654-0b92a4f2e0d6. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5084064a-47ae-49d3-b789-abc6df737bae req-2d1b39f8-4805-4b56-9f2b-8bba30d9bfdd service nova] Acquiring lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG nova.network.neutron [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Updating instance_info_cache with network_info: [{"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Releasing lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG nova.compute.manager [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Instance network_info: |[{"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5084064a-47ae-49d3-b789-abc6df737bae req-2d1b39f8-4805-4b56-9f2b-8bba30d9bfdd service nova] Acquired lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG nova.network.neutron [req-5084064a-47ae-49d3-b789-abc6df737bae req-2d1b39f8-4805-4b56-9f2b-8bba30d9bfdd service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Refreshing network info cache for port 5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG nova.network.neutron [req-5084064a-47ae-49d3-b789-abc6df737bae req-2d1b39f8-4805-4b56-9f2b-8bba30d9bfdd service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Updated VIF entry in instance network info cache for port 5122df04-3e5c-4a22-9654-0b92a4f2e0d6. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG nova.network.neutron [req-5084064a-47ae-49d3-b789-abc6df737bae req-2d1b39f8-4805-4b56-9f2b-8bba30d9bfdd service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Updating instance_info_cache with network_info: [{"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:47:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-5084064a-47ae-49d3-b789-abc6df737bae req-2d1b39f8-4805-4b56-9f2b-8bba30d9bfdd service nova] Releasing lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:48:02 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:48:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:48:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:48:10 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:48:12 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:48:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:48:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:48:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:48:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:48:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:13 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:48:15 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:48:15 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:48:16 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Creating image(s)
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Ensure instance console log exists: /opt/stack/data/nova/instances/42d49781-e408-42a8-a388-ca1770c1bbfb/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Start _get_guest_xml network_info=[{"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuXIYgjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42d49781-e408-42a8-a388-ca1770c1bbfb', 'attached_at': '', 'detached_at': '', 'volume_id': '3ec05e51-a9ae-441e-b3dc-d4b76212a2c7', 'serial': '3ec05e51-a9ae-441e-b3dc-d4b76212a2c7'}, 'boot_index': 0, 'attachment_id': '876e0dfd-d523-4d1e-aa08-f62e8c685578', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:48:16 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:48:16 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuXIYgjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:48:16 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:48:16 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:48:16 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e113494b-b65a-4584-a536-72b2ba0fd360]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:48:16 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c902f48e-e19b-4dd1-bf79-c1c21808645c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7] added
Nov 07 04:48:16 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[463880d7-a248-4d60-99a3-f0b43d145db8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74540) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[30493643-2f14-4662-8734-01a494764807]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuXIYgjx {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuXIYgjx" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a055e3-5bb2-41e2-a18c-a3ec78a02e12]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LuXIYgjx'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fdd724-97ba-400a-9fe4-ddaa49bbf09a]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af557ec-e80f-4b78-8c2b-2dedaa71258b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:48:16 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:48:16 user nova-compute[74540]:  {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:48:16 user nova-compute[74540]: WARNING os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 04:48:16 user nova-compute[74540]: 
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd45a7d-b8ad-4274-818d-b8d8092c1755]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260]
Nov 07 04:48:16 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260] successful.
Nov 07 04:48:16 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8ecf1d-9b43-46d7-aaf7-dee03c7d34b6]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f126bf2f-4095-4b35-acdc-069a96531b63]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:48:16 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:48:16 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c974cc-913e-4dce-92aa-4b812d301aa4]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:48:16 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:48:17 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuXIYgjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23563363766336231', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563363766336231', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1478112140',display_name='tempest-TestVolumeBootPattern-server-1478112140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1478112140',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuqDm761bJfXLRS8w9ppuVTOLmnEkKBKh0Cj4XQjKHqISsPNMn8opt/7jJ76Q+ZHbqAghG3Cb0Kbj8tizrc8moE39Cktw72rga32aL/ugk/2Lf7uUi2pbur/e2P21H2Rw==',key_name='tempest-TestVolumeBootPattern-1167839782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-g6zduh2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:47:56Z,user_data=None,user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=42d49781-e408-42a8-a388-ca1770c1bbfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8d:eb,bridge_name='br-int',has_traffic_filtering=True,id=5122df04-3e5c-4a22-9654-0b92a4f2e0d6,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5122df04-3e') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG nova.objects.instance [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lazy-loading 'pci_devices' on Instance uuid 42d49781-e408-42a8-a388-ca1770c1bbfb {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:48:18 user nova-compute[74540]:   <uuid>42d49781-e408-42a8-a388-ca1770c1bbfb</uuid>
Nov 07 04:48:18 user nova-compute[74540]:   <name>instance-00000032</name>
Nov 07 04:48:18 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:48:18 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:48:18 user nova-compute[74540]:   <metadata>
Nov 07 04:48:18 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:48:18 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:48:18 user nova-compute[74540]:       <nova:name>tempest-TestVolumeBootPattern-server-1478112140</nova:name>
Nov 07 04:48:18 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:48:16</nova:creationTime>
Nov 07 04:48:18 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:48:18 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:48:18 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:48:18 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:48:18 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:48:18 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:48:18 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:48:18 user nova-compute[74540]:       <nova:owner>
Nov 07 04:48:18 user nova-compute[74540]:         <nova:user uuid="23c9b2aeb83c4e2780c123bdb32b9dde">tempest-TestVolumeBootPattern-621203767-project-member</nova:user>
Nov 07 04:48:18 user nova-compute[74540]:         <nova:project uuid="b96003f4fda04df99e4c1e37a139d0f1">tempest-TestVolumeBootPattern-621203767</nova:project>
Nov 07 04:48:18 user nova-compute[74540]:       </nova:owner>
Nov 07 04:48:18 user nova-compute[74540]:       <nova:ports>
Nov 07 04:48:18 user nova-compute[74540]:         <nova:port uuid="5122df04-3e5c-4a22-9654-0b92a4f2e0d6">
Nov 07 04:48:18 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 07 04:48:18 user nova-compute[74540]:         </nova:port>
Nov 07 04:48:18 user nova-compute[74540]:       </nova:ports>
Nov 07 04:48:18 user nova-compute[74540]:     </nova:instance>
Nov 07 04:48:18 user nova-compute[74540]:   </metadata>
Nov 07 04:48:18 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:48:18 user nova-compute[74540]:     <system>
Nov 07 04:48:18 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:48:18 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:48:18 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:48:18 user nova-compute[74540]:       <entry name="serial">42d49781-e408-42a8-a388-ca1770c1bbfb</entry>
Nov 07 04:48:18 user nova-compute[74540]:       <entry name="uuid">42d49781-e408-42a8-a388-ca1770c1bbfb</entry>
Nov 07 04:48:18 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:48:18 user nova-compute[74540]:     </system>
Nov 07 04:48:18 user nova-compute[74540]:   </sysinfo>
Nov 07 04:48:18 user nova-compute[74540]:   <os>
Nov 07 04:48:18 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:48:18 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:48:18 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:48:18 user nova-compute[74540]:   </os>
Nov 07 04:48:18 user nova-compute[74540]:   <features>
Nov 07 04:48:18 user nova-compute[74540]:     <acpi/>
Nov 07 04:48:18 user nova-compute[74540]:     <apic/>
Nov 07 04:48:18 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:48:18 user nova-compute[74540]:   </features>
Nov 07 04:48:18 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:48:18 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:48:18 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:48:18 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:48:18 user nova-compute[74540]:   </clock>
Nov 07 04:48:18 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:48:18 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:48:18 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:48:18 user nova-compute[74540]:   </cpu>
Nov 07 04:48:18 user nova-compute[74540]:   <devices>
Nov 07 04:48:18 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:48:18 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:48:18 user nova-compute[74540]:       <source dev="/dev/sdb"/>
Nov 07 04:48:18 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:48:18 user nova-compute[74540]:       <serial>3ec05e51-a9ae-441e-b3dc-d4b76212a2c7</serial>
Nov 07 04:48:18 user nova-compute[74540]:     </disk>
Nov 07 04:48:18 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:48:18 user nova-compute[74540]:       <mac address="fa:16:3e:2f:8d:eb"/>
Nov 07 04:48:18 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:48:18 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:48:18 user nova-compute[74540]:       <target dev="tap5122df04-3e"/>
Nov 07 04:48:18 user nova-compute[74540]:     </interface>
Nov 07 04:48:18 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:48:18 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/42d49781-e408-42a8-a388-ca1770c1bbfb/console.log" append="off"/>
Nov 07 04:48:18 user nova-compute[74540]:     </serial>
Nov 07 04:48:18 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:48:18 user nova-compute[74540]:     <video>
Nov 07 04:48:18 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:48:18 user nova-compute[74540]:     </video>
Nov 07 04:48:18 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:48:18 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:48:18 user nova-compute[74540]:     </rng>
Nov 07 04:48:18 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:48:18 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:48:18 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:48:18 user nova-compute[74540]:     </memballoon>
Nov 07 04:48:18 user nova-compute[74540]:   </devices>
Nov 07 04:48:18 user nova-compute[74540]: </domain>
Nov 07 04:48:18 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1478112140',display_name='tempest-TestVolumeBootPattern-server-1478112140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1478112140',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuqDm761bJfXLRS8w9ppuVTOLmnEkKBKh0Cj4XQjKHqISsPNMn8opt/7jJ76Q+ZHbqAghG3Cb0Kbj8tizrc8moE39Cktw72rga32aL/ugk/2Lf7uUi2pbur/e2P21H2Rw==',key_name='tempest-TestVolumeBootPattern-1167839782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-g6zduh2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:47:56Z,user_data=None,user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=42d49781-e408-42a8-a388-ca1770c1bbfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8d:eb,bridge_name='br-int',has_traffic_filtering=True,id=5122df04-3e5c-4a22-9654-0b92a4f2e0d6,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5122df04-3e') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG os_vif [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8d:eb,bridge_name='br-int',has_traffic_filtering=True,id=5122df04-3e5c-4a22-9654-0b92a4f2e0d6,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5122df04-3e') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d39ba47-d6e6-5f54-8014-72cd02d76878', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5122df04-3e, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5122df04-3e, col_values=(('qos', UUID('b09dad25-5503-432a-996b-04a0ce1ce6eb')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5122df04-3e, col_values=(('external_ids', {'iface-id': '5122df04-3e5c-4a22-9654-0b92a4f2e0d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:8d:eb', 'vm-uuid': '42d49781-e408-42a8-a388-ca1770c1bbfb'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:18 user nova-compute[74540]: INFO os_vif [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8d:eb,bridge_name='br-int',has_traffic_filtering=True,id=5122df04-3e5c-4a22-9654-0b92a4f2e0d6,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5122df04-3e')
Nov 07 04:48:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:48:18 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] No VIF found with MAC fa:16:3e:2f:8d:eb, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:48:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-7b8302a6-d8cc-4565-b041-dfd1138590a6 req-d7fe813e-2890-4318-8b86-bddb151db27b service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Received event network-vif-plugged-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:48:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7b8302a6-d8cc-4565-b041-dfd1138590a6 req-d7fe813e-2890-4318-8b86-bddb151db27b service nova] Acquiring lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:48:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7b8302a6-d8cc-4565-b041-dfd1138590a6 req-d7fe813e-2890-4318-8b86-bddb151db27b service nova] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:48:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-7b8302a6-d8cc-4565-b041-dfd1138590a6 req-d7fe813e-2890-4318-8b86-bddb151db27b service nova] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:48:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-7b8302a6-d8cc-4565-b041-dfd1138590a6 req-d7fe813e-2890-4318-8b86-bddb151db27b service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] No waiting events found dispatching network-vif-plugged-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:48:19 user nova-compute[74540]: WARNING nova.compute.manager [req-7b8302a6-d8cc-4565-b041-dfd1138590a6 req-d7fe813e-2890-4318-8b86-bddb151db27b service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Received unexpected event network-vif-plugged-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 for instance with vm_state building and task_state spawning.
Nov 07 04:48:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:48:21 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Instance spawned successfully.
Nov 07 04:48:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:48:21 user nova-compute[74540]: INFO nova.compute.manager [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 07 04:48:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-e602a2f2-9bb3-44c3-a4e9-031db8fd5bac req-54445c69-98b4-42e4-bc8f-63f162776859 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Received event network-vif-plugged-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e602a2f2-9bb3-44c3-a4e9-031db8fd5bac req-54445c69-98b4-42e4-bc8f-63f162776859 service nova] Acquiring lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e602a2f2-9bb3-44c3-a4e9-031db8fd5bac req-54445c69-98b4-42e4-bc8f-63f162776859 service nova] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-e602a2f2-9bb3-44c3-a4e9-031db8fd5bac req-54445c69-98b4-42e4-bc8f-63f162776859 service nova] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG nova.compute.manager [req-e602a2f2-9bb3-44c3-a4e9-031db8fd5bac req-54445c69-98b4-42e4-bc8f-63f162776859 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] No waiting events found dispatching network-vif-plugged-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:48:21 user nova-compute[74540]: WARNING nova.compute.manager [req-e602a2f2-9bb3-44c3-a4e9-031db8fd5bac req-54445c69-98b4-42e4-bc8f-63f162776859 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Received unexpected event network-vif-plugged-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 for instance with vm_state building and task_state spawning.
Nov 07 04:48:21 user nova-compute[74540]: INFO nova.compute.manager [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Took 26.09 seconds to build instance.
Nov 07 04:48:21 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-cc10a72d-1f97-4749-b33b-d9ea8fa4b44a tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.181s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:48:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:48:27 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:48:27 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:48:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:48:27 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:48:27 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:48:27 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 42d49781-e408-42a8-a388-ca1770c1bbfb {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:48:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:28 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Updating instance_info_cache with network_info: [{"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:48:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:48:28 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:48:29 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:48:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:48:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:48:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:48:29 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:48:29 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:48:30 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:48:30 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=24.81749725341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 42d49781-e408-42a8-a388-ca1770c1bbfb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing inventories for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating ProviderTree inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing aggregate associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, aggregates: None {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing trait associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 04:48:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] There are 0 instances to clean {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 04:48:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:48:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:48:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:48:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:48:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:48:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:48:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:48:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:48:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:48:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:49:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:12 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:49:12 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:49:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:49:14 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:49:14 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:49:15 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:49:17 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:49:17 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:49:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:49:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:49:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:49:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:49:18 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:18 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:49:19 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:49:23 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:28 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:28 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:49:28 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:49:28 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:49:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:49:28 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:49:28 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:49:28 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid 42d49781-e408-42a8-a388-ca1770c1bbfb {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:49:29 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Updating instance_info_cache with network_info: [{"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:49:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:49:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:49:31 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:49:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:49:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:49:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:49:31 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:49:31 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:49:32 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:49:32 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:49:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=24.816844940185547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:49:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:49:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:49:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance 42d49781-e408-42a8-a388-ca1770c1bbfb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:49:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:49:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:49:32 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:49:32 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:49:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:49:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:49:33 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:38 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:49:43 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-4071b4e2-f739-4f0c-80cb-6db9d4e1f975 req-eb758615-babb-4258-9220-d109b7344591 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Received event network-changed-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:49:47 user nova-compute[74540]: DEBUG nova.compute.manager [req-4071b4e2-f739-4f0c-80cb-6db9d4e1f975 req-eb758615-babb-4258-9220-d109b7344591 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Refreshing instance network info cache due to event network-changed-5122df04-3e5c-4a22-9654-0b92a4f2e0d6. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:49:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4071b4e2-f739-4f0c-80cb-6db9d4e1f975 req-eb758615-babb-4258-9220-d109b7344591 service nova] Acquiring lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:49:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4071b4e2-f739-4f0c-80cb-6db9d4e1f975 req-eb758615-babb-4258-9220-d109b7344591 service nova] Acquired lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:49:47 user nova-compute[74540]: DEBUG nova.network.neutron [req-4071b4e2-f739-4f0c-80cb-6db9d4e1f975 req-eb758615-babb-4258-9220-d109b7344591 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Refreshing network info cache for port 5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG nova.network.neutron [req-4071b4e2-f739-4f0c-80cb-6db9d4e1f975 req-eb758615-babb-4258-9220-d109b7344591 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Updated VIF entry in instance network info cache for port 5122df04-3e5c-4a22-9654-0b92a4f2e0d6. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG nova.network.neutron [req-4071b4e2-f739-4f0c-80cb-6db9d4e1f975 req-eb758615-babb-4258-9220-d109b7344591 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Updating instance_info_cache with network_info: [{"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4071b4e2-f739-4f0c-80cb-6db9d4e1f975 req-eb758615-babb-4258-9220-d109b7344591 service nova] Releasing lock "refresh_cache-42d49781-e408-42a8-a388-ca1770c1bbfb" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "42d49781-e408-42a8-a388-ca1770c1bbfb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:49:48 user nova-compute[74540]: INFO nova.compute.manager [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Terminating instance
Nov 07 04:49:48 user nova-compute[74540]: DEBUG nova.compute.manager [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:48 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Instance destroyed successfully.
Nov 07 04:49:48 user nova-compute[74540]: DEBUG nova.objects.instance [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lazy-loading 'resources' on Instance uuid 42d49781-e408-42a8-a388-ca1770c1bbfb {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1478112140',display_name='tempest-TestVolumeBootPattern-server-1478112140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1478112140',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuqDm761bJfXLRS8w9ppuVTOLmnEkKBKh0Cj4XQjKHqISsPNMn8opt/7jJ76Q+ZHbqAghG3Cb0Kbj8tizrc8moE39Cktw72rga32aL/ugk/2Lf7uUi2pbur/e2P21H2Rw==',key_name='tempest-TestVolumeBootPattern-1167839782',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:48:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-g6zduh2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:48:22Z,user_data=None,user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=42d49781-e408-42a8-a388-ca1770c1bbfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "address": "fa:16:3e:2f:8d:eb", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5122df04-3e", "ovs_interfaceid": "5122df04-3e5c-4a22-9654-0b92a4f2e0d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:8d:eb,bridge_name='br-int',has_traffic_filtering=True,id=5122df04-3e5c-4a22-9654-0b92a4f2e0d6,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5122df04-3e') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:49:48 user nova-compute[74540]: DEBUG os_vif [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:8d:eb,bridge_name='br-int',has_traffic_filtering=True,id=5122df04-3e5c-4a22-9654-0b92a4f2e0d6,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5122df04-3e') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5122df04-3e, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b09dad25-5503-432a-996b-04a0ce1ce6eb) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:49:49 user nova-compute[74540]: INFO os_vif [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:8d:eb,bridge_name='br-int',has_traffic_filtering=True,id=5122df04-3e5c-4a22-9654-0b92a4f2e0d6,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5122df04-3e')
Nov 07 04:49:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuXIYgjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:49:49 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f722f4-8e71-4df0-899f-365d50ecdad7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:49:49 user nova-compute[74540]: No targets found.
Nov 07 04:49:49 user nova-compute[74540]: iSNS:
Nov 07 04:49:49 user nova-compute[74540]: No targets found.
Nov 07 04:49:49 user nova-compute[74540]: STATIC:
Nov 07 04:49:49 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7
Nov 07 04:49:49 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:49:49 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:49:49 user nova-compute[74540]: FIRMWARE:
Nov 07 04:49:49 user nova-compute[74540]: No targets found.
Nov 07 04:49:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:49:49 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:49:49 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74659a4-c880-4e4a-a97f-3c310ca153dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07e3ddb-9a71-4202-9447-50af8e6c1288]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:49:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:49:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedd86612d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ae109f-aea7-4057-b06c-40eeac15f868]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c984704d-09ce-4711-a539-0f133395b688]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea63554-8dc3-40a4-a76c-77e40c017390]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[816b0c0f-2a48-46d7-81c3-1236812dfbec]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd44b4c-3fa8-4612-a507-ee1f1aed3eec]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fad0e7f-f66c-44c5-a1a8-5becc8b932a8]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260]
Nov 07 04:49:49 user nova-compute[74540]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260] successful.
Nov 07 04:49:49 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-8b12c0ba-95e8-4a8f-8d41-b699afcf7be5 req-5c5968dd-d3f1-47b5-8cff-945808ad2264 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Received event network-vif-unplugged-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8b12c0ba-95e8-4a8f-8d41-b699afcf7be5 req-5c5968dd-d3f1-47b5-8cff-945808ad2264 service nova] Acquiring lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8b12c0ba-95e8-4a8f-8d41-b699afcf7be5 req-5c5968dd-d3f1-47b5-8cff-945808ad2264 service nova] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8b12c0ba-95e8-4a8f-8d41-b699afcf7be5 req-5c5968dd-d3f1-47b5-8cff-945808ad2264 service nova] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-8b12c0ba-95e8-4a8f-8d41-b699afcf7be5 req-5c5968dd-d3f1-47b5-8cff-945808ad2264 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] No waiting events found dispatching network-vif-unplugged-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-8b12c0ba-95e8-4a8f-8d41-b699afcf7be5 req-5c5968dd-d3f1-47b5-8cff-945808ad2264 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Received event network-vif-unplugged-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-8b12c0ba-95e8-4a8f-8d41-b699afcf7be5 req-5c5968dd-d3f1-47b5-8cff-945808ad2264 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Received event network-vif-plugged-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8b12c0ba-95e8-4a8f-8d41-b699afcf7be5 req-5c5968dd-d3f1-47b5-8cff-945808ad2264 service nova] Acquiring lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8b12c0ba-95e8-4a8f-8d41-b699afcf7be5 req-5c5968dd-d3f1-47b5-8cff-945808ad2264 service nova] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-8b12c0ba-95e8-4a8f-8d41-b699afcf7be5 req-5c5968dd-d3f1-47b5-8cff-945808ad2264 service nova] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG nova.compute.manager [req-8b12c0ba-95e8-4a8f-8d41-b699afcf7be5 req-5c5968dd-d3f1-47b5-8cff-945808ad2264 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] No waiting events found dispatching network-vif-plugged-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:49:49 user nova-compute[74540]: WARNING nova.compute.manager [req-8b12c0ba-95e8-4a8f-8d41-b699afcf7be5 req-5c5968dd-d3f1-47b5-8cff-945808ad2264 service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Received unexpected event network-vif-plugged-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 for instance with vm_state active and task_state deleting.
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c81b70-bd3f-45ef-a21c-ca92154979f6]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== disconnect_volume: return (326ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:49:49 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Deleting instance files /opt/stack/data/nova/instances/42d49781-e408-42a8-a388-ca1770c1bbfb_del
Nov 07 04:49:49 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Deletion of /opt/stack/data/nova/instances/42d49781-e408-42a8-a388-ca1770c1bbfb_del complete
Nov 07 04:49:49 user nova-compute[74540]: INFO nova.compute.manager [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Took 1.59 seconds to destroy the instance on the hypervisor.
Nov 07 04:49:49 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:49:49 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:49:50 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:49:50 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Took 0.83 seconds to deallocate network for instance.
Nov 07 04:49:50 user nova-compute[74540]: DEBUG nova.compute.manager [req-ae7b994b-539a-4477-92ee-7926b821a230 req-9a9d4061-d5af-4669-b551-9c911b7030bf service nova] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Received event network-vif-deleted-5122df04-3e5c-4a22-9654-0b92a4f2e0d6 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:49:51 user nova-compute[74540]: INFO nova.compute.manager [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: 42d49781-e408-42a8-a388-ca1770c1bbfb] Took 0.96 seconds to detach 1 volumes for instance.
Nov 07 04:49:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:49:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:49:51 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:49:51 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:49:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:49:51 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Deleted allocations for instance 42d49781-e408-42a8-a388-ca1770c1bbfb
Nov 07 04:49:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-611ebed6-a4cd-43a4-913f-04f413bf770d tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "42d49781-e408-42a8-a388-ca1770c1bbfb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.671s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:49:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:49:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:50:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:50:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:50:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:50:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:50:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:50:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:50:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:50:14 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:50:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:50:14 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:50:14 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:50:16 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:50:18 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:50:18 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:50:18 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:50:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:50:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:50:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:50:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:50:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:50:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:50:20 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:50:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:50:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:50:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:50:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:50:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:50:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:50:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:50:29 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:50:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:50:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:50:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 04:50:32 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:50:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:50:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:50:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:50:32 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:50:33 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:50:33 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:50:33 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=9110MB free_disk=24.8160400390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:50:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:50:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:50:33 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:50:33 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:50:33 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:50:33 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:50:33 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:50:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:50:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:50:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "cd17af04-e036-495f-aeb5-c7c6e5592b06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG nova.compute.manager [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:50:40 user nova-compute[74540]: INFO nova.compute.claims [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Claim successful on node user
Nov 07 04:50:40 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG nova.compute.manager [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG nova.compute.manager [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG nova.network.neutron [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:50:40 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:50:40 user nova-compute[74540]: DEBUG nova.compute.manager [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:50:40 user nova-compute[74540]: INFO nova.virt.block_device [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Booting with volume 3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 at /dev/vda
Nov 07 04:50:40 user nova-compute[74540]: DEBUG nova.policy [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23c9b2aeb83c4e2780c123bdb32b9dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96003f4fda04df99e4c1e37a139d0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG os_brick.utils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d74347-abc3-470d-a730-863915c89bf4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3209f76f-a833-413f-b054-6734bd15c020]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf35c251-3b69-45f0-b7ae-600006cd73cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c048b5fc-a6f6-4dad-848d-eed0c98c2287]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:50:40 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:50:40 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59c24cf-f67d-4397-8d64-c326b0b3a484]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG os_brick.utils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:50:40 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updating existing volume attachment record: 4412d71b-7dba-4441-a8ac-e331bbf294e1 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:50:41 user nova-compute[74540]: DEBUG nova.network.neutron [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Successfully created port: 0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:50:42 user nova-compute[74540]: DEBUG nova.network.neutron [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Successfully updated port: 0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:50:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:50:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquired lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:50:42 user nova-compute[74540]: DEBUG nova.network.neutron [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:50:42 user nova-compute[74540]: DEBUG nova.network.neutron [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:50:42 user nova-compute[74540]: DEBUG nova.network.neutron [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updating instance_info_cache with network_info: [{"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:50:42 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Releasing lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:50:42 user nova-compute[74540]: DEBUG nova.compute.manager [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Instance network_info: |[{"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:50:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-da9996ef-f088-4a1a-a61f-48e51b4ee6f9 req-05fbb90d-53af-49df-b262-234bee7fe809 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Received event network-changed-0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:50:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-da9996ef-f088-4a1a-a61f-48e51b4ee6f9 req-05fbb90d-53af-49df-b262-234bee7fe809 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Refreshing instance network info cache due to event network-changed-0c0c9dbc-75b1-486c-8345-a1f20ab63efb. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:50:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-da9996ef-f088-4a1a-a61f-48e51b4ee6f9 req-05fbb90d-53af-49df-b262-234bee7fe809 service nova] Acquiring lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:50:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-da9996ef-f088-4a1a-a61f-48e51b4ee6f9 req-05fbb90d-53af-49df-b262-234bee7fe809 service nova] Acquired lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:50:43 user nova-compute[74540]: DEBUG nova.network.neutron [req-da9996ef-f088-4a1a-a61f-48e51b4ee6f9 req-05fbb90d-53af-49df-b262-234bee7fe809 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Refreshing network info cache for port 0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:50:43 user nova-compute[74540]: DEBUG nova.network.neutron [req-da9996ef-f088-4a1a-a61f-48e51b4ee6f9 req-05fbb90d-53af-49df-b262-234bee7fe809 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updated VIF entry in instance network info cache for port 0c0c9dbc-75b1-486c-8345-a1f20ab63efb. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:50:43 user nova-compute[74540]: DEBUG nova.network.neutron [req-da9996ef-f088-4a1a-a61f-48e51b4ee6f9 req-05fbb90d-53af-49df-b262-234bee7fe809 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updating instance_info_cache with network_info: [{"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:50:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-da9996ef-f088-4a1a-a61f-48e51b4ee6f9 req-05fbb90d-53af-49df-b262-234bee7fe809 service nova] Releasing lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:50:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:50:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:50:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:50:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:50:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:50:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:50:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:50:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:50:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.compute.manager [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:51:01 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Creating image(s)
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Ensure instance console log exists: /opt/stack/data/nova/instances/cd17af04-e036-495f-aeb5-c7c6e5592b06/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Start _get_guest_xml network_info=[{"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuXIYgjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cd17af04-e036-495f-aeb5-c7c6e5592b06', 'attached_at': '', 'detached_at': '', 'volume_id': '3ec05e51-a9ae-441e-b3dc-d4b76212a2c7', 'serial': '3ec05e51-a9ae-441e-b3dc-d4b76212a2c7'}, 'boot_index': 0, 'attachment_id': '4412d71b-7dba-4441-a8ac-e331bbf294e1', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:51:01 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:51:01 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuXIYgjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:51:01 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:51:01 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:51:01 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf14ad5-69ee-4083-aa24-1d2ec3473eb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:51:01 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bdeb80-cc4e-4e82-b487-a2bff5ed9dd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7] added
Nov 07 04:51:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.118s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cb319f-f388-40fb-a09c-a13d9aa62d76]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f211cb-0936-4b5b-8c13-2001359d0df8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuXIYgjx {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuXIYgjx" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b0bee4-31db-42b7-8102-ff7e9d202acf]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LuXIYgjx'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6684f855-9fdd-4cee-b032-0c4b6ff43c78]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[15999122-01da-4a63-9cb3-cb805aaccf0f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:51:01 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 07 04:51:01 user nova-compute[74540]:  {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:51:01 user nova-compute[74540]: WARNING os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 07 04:51:01 user nova-compute[74540]: 
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f8c903-7820-453a-98fb-fb01e0b94fab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260]
Nov 07 04:51:01 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260] successful.
Nov 07 04:51:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4e641d-1112-4819-8acb-4f3a8d6d32bc]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[042ad57f-064e-431f-9f02-c80e74e1e80f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:51:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:51:01 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0eb1a7-ab4a-420a-91d2-09dd7e4485a2]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:51:01 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuXIYgjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23563363766336231', 'path': '/dev/sdb'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563363766336231', 'path': '/dev/sdb'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1429431724',display_name='tempest-TestVolumeBootPattern-server-1429431724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1429431724',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuqDm761bJfXLRS8w9ppuVTOLmnEkKBKh0Cj4XQjKHqISsPNMn8opt/7jJ76Q+ZHbqAghG3Cb0Kbj8tizrc8moE39Cktw72rga32aL/ugk/2Lf7uUi2pbur/e2P21H2Rw==',key_name='tempest-TestVolumeBootPattern-1167839782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-60ryzdv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:50:41Z,user_data=None,user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=cd17af04-e036-495f-aeb5-c7c6e5592b06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e1:35,bridge_name='br-int',has_traffic_filtering=True,id=0c0c9dbc-75b1-486c-8345-a1f20ab63efb,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0c9dbc-75') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG nova.objects.instance [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lazy-loading 'pci_devices' on Instance uuid cd17af04-e036-495f-aeb5-c7c6e5592b06 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:51:02 user nova-compute[74540]:   <uuid>cd17af04-e036-495f-aeb5-c7c6e5592b06</uuid>
Nov 07 04:51:02 user nova-compute[74540]:   <name>instance-00000033</name>
Nov 07 04:51:02 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:51:02 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:51:02 user nova-compute[74540]:   <metadata>
Nov 07 04:51:02 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:51:02 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:51:02 user nova-compute[74540]:       <nova:name>tempest-TestVolumeBootPattern-server-1429431724</nova:name>
Nov 07 04:51:02 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:51:01</nova:creationTime>
Nov 07 04:51:02 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:51:02 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:51:02 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:51:02 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:51:02 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:51:02 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:51:02 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:51:02 user nova-compute[74540]:       <nova:owner>
Nov 07 04:51:02 user nova-compute[74540]:         <nova:user uuid="23c9b2aeb83c4e2780c123bdb32b9dde">tempest-TestVolumeBootPattern-621203767-project-member</nova:user>
Nov 07 04:51:02 user nova-compute[74540]:         <nova:project uuid="b96003f4fda04df99e4c1e37a139d0f1">tempest-TestVolumeBootPattern-621203767</nova:project>
Nov 07 04:51:02 user nova-compute[74540]:       </nova:owner>
Nov 07 04:51:02 user nova-compute[74540]:       <nova:ports>
Nov 07 04:51:02 user nova-compute[74540]:         <nova:port uuid="0c0c9dbc-75b1-486c-8345-a1f20ab63efb">
Nov 07 04:51:02 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 07 04:51:02 user nova-compute[74540]:         </nova:port>
Nov 07 04:51:02 user nova-compute[74540]:       </nova:ports>
Nov 07 04:51:02 user nova-compute[74540]:     </nova:instance>
Nov 07 04:51:02 user nova-compute[74540]:   </metadata>
Nov 07 04:51:02 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:51:02 user nova-compute[74540]:     <system>
Nov 07 04:51:02 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:51:02 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:51:02 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:51:02 user nova-compute[74540]:       <entry name="serial">cd17af04-e036-495f-aeb5-c7c6e5592b06</entry>
Nov 07 04:51:02 user nova-compute[74540]:       <entry name="uuid">cd17af04-e036-495f-aeb5-c7c6e5592b06</entry>
Nov 07 04:51:02 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:51:02 user nova-compute[74540]:     </system>
Nov 07 04:51:02 user nova-compute[74540]:   </sysinfo>
Nov 07 04:51:02 user nova-compute[74540]:   <os>
Nov 07 04:51:02 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:51:02 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:51:02 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:51:02 user nova-compute[74540]:   </os>
Nov 07 04:51:02 user nova-compute[74540]:   <features>
Nov 07 04:51:02 user nova-compute[74540]:     <acpi/>
Nov 07 04:51:02 user nova-compute[74540]:     <apic/>
Nov 07 04:51:02 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:51:02 user nova-compute[74540]:   </features>
Nov 07 04:51:02 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:51:02 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:51:02 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:51:02 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:51:02 user nova-compute[74540]:   </clock>
Nov 07 04:51:02 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:51:02 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:51:02 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:51:02 user nova-compute[74540]:   </cpu>
Nov 07 04:51:02 user nova-compute[74540]:   <devices>
Nov 07 04:51:02 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:51:02 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:51:02 user nova-compute[74540]:       <source dev="/dev/sdb"/>
Nov 07 04:51:02 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:51:02 user nova-compute[74540]:       <serial>3ec05e51-a9ae-441e-b3dc-d4b76212a2c7</serial>
Nov 07 04:51:02 user nova-compute[74540]:     </disk>
Nov 07 04:51:02 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:51:02 user nova-compute[74540]:       <mac address="fa:16:3e:9a:e1:35"/>
Nov 07 04:51:02 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:51:02 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:51:02 user nova-compute[74540]:       <target dev="tap0c0c9dbc-75"/>
Nov 07 04:51:02 user nova-compute[74540]:     </interface>
Nov 07 04:51:02 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:51:02 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/cd17af04-e036-495f-aeb5-c7c6e5592b06/console.log" append="off"/>
Nov 07 04:51:02 user nova-compute[74540]:     </serial>
Nov 07 04:51:02 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:51:02 user nova-compute[74540]:     <video>
Nov 07 04:51:02 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:51:02 user nova-compute[74540]:     </video>
Nov 07 04:51:02 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:51:02 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:51:02 user nova-compute[74540]:     </rng>
Nov 07 04:51:02 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:51:02 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:51:02 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:51:02 user nova-compute[74540]:     </memballoon>
Nov 07 04:51:02 user nova-compute[74540]:   </devices>
Nov 07 04:51:02 user nova-compute[74540]: </domain>
Nov 07 04:51:02 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1429431724',display_name='tempest-TestVolumeBootPattern-server-1429431724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1429431724',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuqDm761bJfXLRS8w9ppuVTOLmnEkKBKh0Cj4XQjKHqISsPNMn8opt/7jJ76Q+ZHbqAghG3Cb0Kbj8tizrc8moE39Cktw72rga32aL/ugk/2Lf7uUi2pbur/e2P21H2Rw==',key_name='tempest-TestVolumeBootPattern-1167839782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-60ryzdv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:50:41Z,user_data=None,user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=cd17af04-e036-495f-aeb5-c7c6e5592b06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e1:35,bridge_name='br-int',has_traffic_filtering=True,id=0c0c9dbc-75b1-486c-8345-a1f20ab63efb,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0c9dbc-75') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG os_vif [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e1:35,bridge_name='br-int',has_traffic_filtering=True,id=0c0c9dbc-75b1-486c-8345-a1f20ab63efb,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0c9dbc-75') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9017dbea-adcf-598a-9ff2-d8c9352804bc', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c0c9dbc-75, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c0c9dbc-75, col_values=(('qos', UUID('8aad9c8b-4d58-411a-b502-5e4c461edbfd')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c0c9dbc-75, col_values=(('external_ids', {'iface-id': '0c0c9dbc-75b1-486c-8345-a1f20ab63efb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:e1:35', 'vm-uuid': 'cd17af04-e036-495f-aeb5-c7c6e5592b06'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:51:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:02 user nova-compute[74540]: INFO os_vif [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e1:35,bridge_name='br-int',has_traffic_filtering=True,id=0c0c9dbc-75b1-486c-8345-a1f20ab63efb,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0c9dbc-75')
Nov 07 04:51:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:51:03 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] No VIF found with MAC fa:16:3e:9a:e1:35, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:51:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-36a26a20-7bd2-4a37-afea-32266ab6c289 req-30a351d2-39f9-43f7-a290-ccd4e354a98e service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Received event network-vif-plugged-0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:51:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-36a26a20-7bd2-4a37-afea-32266ab6c289 req-30a351d2-39f9-43f7-a290-ccd4e354a98e service nova] Acquiring lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:51:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-36a26a20-7bd2-4a37-afea-32266ab6c289 req-30a351d2-39f9-43f7-a290-ccd4e354a98e service nova] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:51:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-36a26a20-7bd2-4a37-afea-32266ab6c289 req-30a351d2-39f9-43f7-a290-ccd4e354a98e service nova] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:51:04 user nova-compute[74540]: DEBUG nova.compute.manager [req-36a26a20-7bd2-4a37-afea-32266ab6c289 req-30a351d2-39f9-43f7-a290-ccd4e354a98e service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] No waiting events found dispatching network-vif-plugged-0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:51:04 user nova-compute[74540]: WARNING nova.compute.manager [req-36a26a20-7bd2-4a37-afea-32266ab6c289 req-30a351d2-39f9-43f7-a290-ccd4e354a98e service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Received unexpected event network-vif-plugged-0c0c9dbc-75b1-486c-8345-a1f20ab63efb for instance with vm_state building and task_state spawning.
Nov 07 04:51:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:51:06 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Instance spawned successfully.
Nov 07 04:51:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:51:06 user nova-compute[74540]: INFO nova.compute.manager [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 07 04:51:06 user nova-compute[74540]: DEBUG nova.compute.manager [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:51:06 user nova-compute[74540]: INFO nova.compute.manager [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Took 26.31 seconds to build instance.
Nov 07 04:51:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-dbce58b3-63b9-4447-aab6-677baf27ea57 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.408s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-4662d33b-05bc-4a2f-a171-d5d333b13ab5 req-815abc19-5afc-4ca0-bd9d-b2d43eef49c7 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Received event network-vif-plugged-0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4662d33b-05bc-4a2f-a171-d5d333b13ab5 req-815abc19-5afc-4ca0-bd9d-b2d43eef49c7 service nova] Acquiring lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4662d33b-05bc-4a2f-a171-d5d333b13ab5 req-815abc19-5afc-4ca0-bd9d-b2d43eef49c7 service nova] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4662d33b-05bc-4a2f-a171-d5d333b13ab5 req-815abc19-5afc-4ca0-bd9d-b2d43eef49c7 service nova] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:51:06 user nova-compute[74540]: DEBUG nova.compute.manager [req-4662d33b-05bc-4a2f-a171-d5d333b13ab5 req-815abc19-5afc-4ca0-bd9d-b2d43eef49c7 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] No waiting events found dispatching network-vif-plugged-0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:51:06 user nova-compute[74540]: WARNING nova.compute.manager [req-4662d33b-05bc-4a2f-a171-d5d333b13ab5 req-815abc19-5afc-4ca0-bd9d-b2d43eef49c7 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Received unexpected event network-vif-plugged-0c0c9dbc-75b1-486c-8345-a1f20ab63efb for instance with vm_state active and task_state None.
Nov 07 04:51:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:14 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:51:14 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:51:14 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:51:16 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:51:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:18 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:51:18 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:51:18 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:51:20 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:51:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:51:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:29 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:51:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:51:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:51:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:51:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:51:29 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:51:29 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid cd17af04-e036-495f-aeb5-c7c6e5592b06 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:51:30 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updating instance_info_cache with network_info: [{"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:51:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:51:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:51:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:33 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:51:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:51:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:51:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:51:33 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:51:33 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:51:34 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:51:34 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:51:34 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=24.814311981201172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:51:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:51:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:51:34 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cd17af04-e036-495f-aeb5-c7c6e5592b06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:51:34 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:51:34 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:51:34 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:51:34 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:51:34 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:51:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:51:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:51:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:51:52 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:51:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:51:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:51:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:51:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:51:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:02 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:52:12 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:52:15 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:52:15 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:52:17 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:52:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:52:19 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:52:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:52:20 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:52:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:52:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:52:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:52:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:52:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:52:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:52:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:52:27 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:52:29 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:52:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:52:29 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:52:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:52:29 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:52:29 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:52:29 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid cd17af04-e036-495f-aeb5-c7c6e5592b06 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:52:30 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updating instance_info_cache with network_info: [{"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:52:30 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:52:30 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:52:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-4fa3dd12-6a7e-437a-9729-bf4dffec7d42 req-43374022-25e6-4319-9bf1-5621eb4eba6b service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Received event network-changed-0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:52:31 user nova-compute[74540]: DEBUG nova.compute.manager [req-4fa3dd12-6a7e-437a-9729-bf4dffec7d42 req-43374022-25e6-4319-9bf1-5621eb4eba6b service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Refreshing instance network info cache due to event network-changed-0c0c9dbc-75b1-486c-8345-a1f20ab63efb. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:52:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4fa3dd12-6a7e-437a-9729-bf4dffec7d42 req-43374022-25e6-4319-9bf1-5621eb4eba6b service nova] Acquiring lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:52:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4fa3dd12-6a7e-437a-9729-bf4dffec7d42 req-43374022-25e6-4319-9bf1-5621eb4eba6b service nova] Acquired lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:52:31 user nova-compute[74540]: DEBUG nova.network.neutron [req-4fa3dd12-6a7e-437a-9729-bf4dffec7d42 req-43374022-25e6-4319-9bf1-5621eb4eba6b service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Refreshing network info cache for port 0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:52:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:32 user nova-compute[74540]: DEBUG nova.network.neutron [req-4fa3dd12-6a7e-437a-9729-bf4dffec7d42 req-43374022-25e6-4319-9bf1-5621eb4eba6b service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updated VIF entry in instance network info cache for port 0c0c9dbc-75b1-486c-8345-a1f20ab63efb. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:52:32 user nova-compute[74540]: DEBUG nova.network.neutron [req-4fa3dd12-6a7e-437a-9729-bf4dffec7d42 req-43374022-25e6-4319-9bf1-5621eb4eba6b service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updating instance_info_cache with network_info: [{"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:52:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4fa3dd12-6a7e-437a-9729-bf4dffec7d42 req-43374022-25e6-4319-9bf1-5621eb4eba6b service nova] Releasing lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:52:32 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:34 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:52:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:52:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:52:34 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:52:34 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:52:34 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:52:35 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:52:35 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:52:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=24.81363296508789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:52:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:52:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:52:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cd17af04-e036-495f-aeb5-c7c6e5592b06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:52:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:52:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:52:35 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:52:35 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:52:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:52:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:52:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "a84cf003-a629-40ad-b9e4-055722fa1097" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:52:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "a84cf003-a629-40ad-b9e4-055722fa1097" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:52:51 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Starting instance... {{(pid=74540) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 07 04:52:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:52:51 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:52:51 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74540) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 07 04:52:51 user nova-compute[74540]: INFO nova.compute.claims [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Claim successful on node user
Nov 07 04:52:52 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Start building networks asynchronously for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Allocating IP information in the background. {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] allocate_for_instance() {{(pid=74540) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 07 04:52:52 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 07 04:52:52 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Start building block device mappings for instance. {{(pid=74540) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG nova.policy [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '23c9b2aeb83c4e2780c123bdb32b9dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96003f4fda04df99e4c1e37a139d0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74540) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 07 04:52:52 user nova-compute[74540]: INFO nova.virt.block_device [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Booting with volume 2b2fb1b7-4a32-4b18-8d6f-196568641ced at /dev/vda
Nov 07 04:52:52 user nova-compute[74540]: DEBUG os_brick.utils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[55824ba2-f8bb-416b-900b-7705fa11c0e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:5f889ccffd93\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9e13c8-ad06-4907-89f0-2ba2ada584cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[231f023e-39f7-4ab1-90a2-b40bbd444bd1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c5f077-6464-477d-8f0f-635a359162f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Running cmd (subprocess): nvme version {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] 'nvme version' failed. Not Retrying. {{(pid=74540) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] nvme not present on system {{(pid=74540) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 07 04:52:52 user nova-compute[74540]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 07 04:52:52 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[962930ad-15ab-4344-8d7e-5dd5896ac2cb]: (4, '') {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74540) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.lightos [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] LIGHTOS: no hostnqn found. {{(pid=74540) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG os_brick.utils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:5f889ccffd93', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:52:52 user nova-compute[74540]: DEBUG nova.virt.block_device [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Updating existing volume attachment record: 9169ecbc-c863-4a32-b7dc-4e62fe56f237 {{(pid=74540) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 07 04:52:53 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:52:53 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Successfully created port: de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Successfully updated port: de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquired lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Building network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-87e6a0d8-f417-4a2e-8a99-96d25cdd6dc0 req-91fd6371-d4f0-40af-9393-00c6321c2b6b service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-changed-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG nova.compute.manager [req-87e6a0d8-f417-4a2e-8a99-96d25cdd6dc0 req-91fd6371-d4f0-40af-9393-00c6321c2b6b service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Refreshing instance network info cache due to event network-changed-de680766-1f0f-459b-8dc3-6e5771ee8102. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-87e6a0d8-f417-4a2e-8a99-96d25cdd6dc0 req-91fd6371-d4f0-40af-9393-00c6321c2b6b service nova] Acquiring lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Instance cache missing network info. {{(pid=74540) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG nova.network.neutron [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Updating instance_info_cache with network_info: [{"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Releasing lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Instance network_info: |[{"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74540) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-87e6a0d8-f417-4a2e-8a99-96d25cdd6dc0 req-91fd6371-d4f0-40af-9393-00c6321c2b6b service nova] Acquired lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG nova.network.neutron [req-87e6a0d8-f417-4a2e-8a99-96d25cdd6dc0 req-91fd6371-d4f0-40af-9393-00c6321c2b6b service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Refreshing network info cache for port de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG nova.network.neutron [req-87e6a0d8-f417-4a2e-8a99-96d25cdd6dc0 req-91fd6371-d4f0-40af-9393-00c6321c2b6b service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Updated VIF entry in instance network info cache for port de680766-1f0f-459b-8dc3-6e5771ee8102. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG nova.network.neutron [req-87e6a0d8-f417-4a2e-8a99-96d25cdd6dc0 req-91fd6371-d4f0-40af-9393-00c6321c2b6b service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Updating instance_info_cache with network_info: [{"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:52:54 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-87e6a0d8-f417-4a2e-8a99-96d25cdd6dc0 req-91fd6371-d4f0-40af-9393-00c6321c2b6b service nova] Releasing lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:52:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:53:05 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:07 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:08 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Start spawning the instance on the hypervisor. {{(pid=74540) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Creating instance directory {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 07 04:53:13 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Creating image(s)
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Did not create local disks {{(pid=74540) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Ensure instance console log exists: /opt/stack/data/nova/instances/a84cf003-a629-40ad-b9e4-055722fa1097/console.log {{(pid=74540) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Start _get_guest_xml network_info=[{"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZnWCOUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a84cf003-a629-40ad-b9e4-055722fa1097', 'attached_at': '', 'detached_at': '', 'volume_id': '2b2fb1b7-4a32-4b18-8d6f-196568641ced', 'serial': '2b2fb1b7-4a32-4b18-8d6f-196568641ced'}, 'boot_index': 0, 'attachment_id': '9169ecbc-c863-4a32-b7dc-4e62fe56f237', 'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 07 04:53:13 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:53:13 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU controller missing on host. {{(pid=74540) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.host [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU controller found on host. {{(pid=74540) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74540) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-07T03:52:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flavor limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Image limits 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flavor pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Image pref 0:0:0 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74540) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Got 1 possible topologies {{(pid=74540) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.hardware [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74540) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Calling os-brick to attach iSCSI Volume {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZnWCOUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:53:13 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:53:13 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:53:13 user nova-compute[74540]: INFO os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8276b53-5148-4863-96f1-851c1fe287c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 07 04:53:13 user nova-compute[74540]:  {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --interface default --op new {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b26d5-8626-4b2d-880e-0b087e9d2250]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced] added\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced] added
Nov 07 04:53:13 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d39b7a-4382-427d-a05c-e12a93b2c77c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d4d5bf-0f95-4afe-b57c-693a2f3a707b]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZnWCOUR {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZnWCOUR" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7fcb69-4f11-46f2-85c4-a48e39df7d7e]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZnWCOUR'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb62593-8830-4e76-8442-670e7f4c80a8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff1e07c-0521-4a40-9fda-16417e90581f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:53:13 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:53:13 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:53:13 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --login {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --login" returned: 0 in 1.050s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa29224-b308-45bf-8a74-7869e7c0644e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced, portal: 172.16.0.220,3260]
Nov 07 04:53:15 user nova-compute[74540]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced, portal: 172.16.0.220,3260] successful.
Nov 07 04:53:15 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1240c8-5835-4c7f-85a4-12f640610ba9]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2f690c-b138-45d4-a173-015cf36a543b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:53:15 user nova-compute[74540]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced (non-flash)
Nov 07 04:53:15 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:53:15 user nova-compute[74540]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced (non-flash)
Nov 07 04:53:15 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.273s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Connected to 172.16.0.220:3260 {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74540) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74540) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4b69fd-f81a-47cd-9117-3d64e3afccfb]: (4, ('- - 0', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74540) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZnWCOUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74540) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 07 04:53:15 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.304s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== connect_volume: return (2305ms) {'type': 'block', 'scsi_wwn': '23462613065386162', 'path': '/dev/sdc'} {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462613065386162', 'path': '/dev/sdc'} {{(pid=74540) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1761490995',display_name='tempest-TestVolumeBootPattern-server-1761490995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1761490995',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuqDm761bJfXLRS8w9ppuVTOLmnEkKBKh0Cj4XQjKHqISsPNMn8opt/7jJ76Q+ZHbqAghG3Cb0Kbj8tizrc8moE39Cktw72rga32aL/ugk/2Lf7uUi2pbur/e2P21H2Rw==',key_name='tempest-TestVolumeBootPattern-1167839782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-kjwnxo4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:52:52Z,user_data=None,user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=a84cf003-a629-40ad-b9e4-055722fa1097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74540) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=de680766-1f0f-459b-8dc3-6e5771ee8102,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde680766-1f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG nova.objects.instance [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lazy-loading 'pci_devices' on Instance uuid a84cf003-a629-40ad-b9e4-055722fa1097 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] End _get_guest_xml xml=<domain type="kvm">
Nov 07 04:53:16 user nova-compute[74540]:   <uuid>a84cf003-a629-40ad-b9e4-055722fa1097</uuid>
Nov 07 04:53:16 user nova-compute[74540]:   <name>instance-00000034</name>
Nov 07 04:53:16 user nova-compute[74540]:   <memory>524288</memory>
Nov 07 04:53:16 user nova-compute[74540]:   <vcpu>1</vcpu>
Nov 07 04:53:16 user nova-compute[74540]:   <metadata>
Nov 07 04:53:16 user nova-compute[74540]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 07 04:53:16 user nova-compute[74540]:       <nova:package version="0.0.0"/>
Nov 07 04:53:16 user nova-compute[74540]:       <nova:name>tempest-TestVolumeBootPattern-server-1761490995</nova:name>
Nov 07 04:53:16 user nova-compute[74540]:       <nova:creationTime>2023-11-07 04:53:13</nova:creationTime>
Nov 07 04:53:16 user nova-compute[74540]:       <nova:flavor name="m1.tiny">
Nov 07 04:53:16 user nova-compute[74540]:         <nova:memory>512</nova:memory>
Nov 07 04:53:16 user nova-compute[74540]:         <nova:disk>1</nova:disk>
Nov 07 04:53:16 user nova-compute[74540]:         <nova:swap>0</nova:swap>
Nov 07 04:53:16 user nova-compute[74540]:         <nova:ephemeral>0</nova:ephemeral>
Nov 07 04:53:16 user nova-compute[74540]:         <nova:vcpus>1</nova:vcpus>
Nov 07 04:53:16 user nova-compute[74540]:       </nova:flavor>
Nov 07 04:53:16 user nova-compute[74540]:       <nova:owner>
Nov 07 04:53:16 user nova-compute[74540]:         <nova:user uuid="23c9b2aeb83c4e2780c123bdb32b9dde">tempest-TestVolumeBootPattern-621203767-project-member</nova:user>
Nov 07 04:53:16 user nova-compute[74540]:         <nova:project uuid="b96003f4fda04df99e4c1e37a139d0f1">tempest-TestVolumeBootPattern-621203767</nova:project>
Nov 07 04:53:16 user nova-compute[74540]:       </nova:owner>
Nov 07 04:53:16 user nova-compute[74540]:       <nova:ports>
Nov 07 04:53:16 user nova-compute[74540]:         <nova:port uuid="de680766-1f0f-459b-8dc3-6e5771ee8102">
Nov 07 04:53:16 user nova-compute[74540]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 07 04:53:16 user nova-compute[74540]:         </nova:port>
Nov 07 04:53:16 user nova-compute[74540]:       </nova:ports>
Nov 07 04:53:16 user nova-compute[74540]:     </nova:instance>
Nov 07 04:53:16 user nova-compute[74540]:   </metadata>
Nov 07 04:53:16 user nova-compute[74540]:   <sysinfo type="smbios">
Nov 07 04:53:16 user nova-compute[74540]:     <system>
Nov 07 04:53:16 user nova-compute[74540]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 07 04:53:16 user nova-compute[74540]:       <entry name="product">OpenStack Nova</entry>
Nov 07 04:53:16 user nova-compute[74540]:       <entry name="version">0.0.0</entry>
Nov 07 04:53:16 user nova-compute[74540]:       <entry name="serial">a84cf003-a629-40ad-b9e4-055722fa1097</entry>
Nov 07 04:53:16 user nova-compute[74540]:       <entry name="uuid">a84cf003-a629-40ad-b9e4-055722fa1097</entry>
Nov 07 04:53:16 user nova-compute[74540]:       <entry name="family">Virtual Machine</entry>
Nov 07 04:53:16 user nova-compute[74540]:     </system>
Nov 07 04:53:16 user nova-compute[74540]:   </sysinfo>
Nov 07 04:53:16 user nova-compute[74540]:   <os>
Nov 07 04:53:16 user nova-compute[74540]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 07 04:53:16 user nova-compute[74540]:     <boot dev="hd"/>
Nov 07 04:53:16 user nova-compute[74540]:     <smbios mode="sysinfo"/>
Nov 07 04:53:16 user nova-compute[74540]:   </os>
Nov 07 04:53:16 user nova-compute[74540]:   <features>
Nov 07 04:53:16 user nova-compute[74540]:     <acpi/>
Nov 07 04:53:16 user nova-compute[74540]:     <apic/>
Nov 07 04:53:16 user nova-compute[74540]:     <vmcoreinfo/>
Nov 07 04:53:16 user nova-compute[74540]:   </features>
Nov 07 04:53:16 user nova-compute[74540]:   <clock offset="utc">
Nov 07 04:53:16 user nova-compute[74540]:     <timer name="pit" tickpolicy="delay"/>
Nov 07 04:53:16 user nova-compute[74540]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 07 04:53:16 user nova-compute[74540]:     <timer name="hpet" present="no"/>
Nov 07 04:53:16 user nova-compute[74540]:   </clock>
Nov 07 04:53:16 user nova-compute[74540]:   <cpu mode="custom" match="exact">
Nov 07 04:53:16 user nova-compute[74540]:     <model>Nehalem</model>
Nov 07 04:53:16 user nova-compute[74540]:     <topology sockets="1" cores="1" threads="1"/>
Nov 07 04:53:16 user nova-compute[74540]:   </cpu>
Nov 07 04:53:16 user nova-compute[74540]:   <devices>
Nov 07 04:53:16 user nova-compute[74540]:     <disk type="block" device="disk">
Nov 07 04:53:16 user nova-compute[74540]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 07 04:53:16 user nova-compute[74540]:       <source dev="/dev/sdc"/>
Nov 07 04:53:16 user nova-compute[74540]:       <target dev="vda" bus="virtio"/>
Nov 07 04:53:16 user nova-compute[74540]:       <serial>2b2fb1b7-4a32-4b18-8d6f-196568641ced</serial>
Nov 07 04:53:16 user nova-compute[74540]:     </disk>
Nov 07 04:53:16 user nova-compute[74540]:     <interface type="ethernet">
Nov 07 04:53:16 user nova-compute[74540]:       <mac address="fa:16:3e:b7:7d:17"/>
Nov 07 04:53:16 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:53:16 user nova-compute[74540]:       <mtu size="1442"/>
Nov 07 04:53:16 user nova-compute[74540]:       <target dev="tapde680766-1f"/>
Nov 07 04:53:16 user nova-compute[74540]:     </interface>
Nov 07 04:53:16 user nova-compute[74540]:     <serial type="pty">
Nov 07 04:53:16 user nova-compute[74540]:       <log file="/opt/stack/data/nova/instances/a84cf003-a629-40ad-b9e4-055722fa1097/console.log" append="off"/>
Nov 07 04:53:16 user nova-compute[74540]:     </serial>
Nov 07 04:53:16 user nova-compute[74540]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 07 04:53:16 user nova-compute[74540]:     <video>
Nov 07 04:53:16 user nova-compute[74540]:       <model type="virtio"/>
Nov 07 04:53:16 user nova-compute[74540]:     </video>
Nov 07 04:53:16 user nova-compute[74540]:     <rng model="virtio">
Nov 07 04:53:16 user nova-compute[74540]:       <backend model="random">/dev/urandom</backend>
Nov 07 04:53:16 user nova-compute[74540]:     </rng>
Nov 07 04:53:16 user nova-compute[74540]:     <controller type="usb" index="0" model="none"/>
Nov 07 04:53:16 user nova-compute[74540]:     <memballoon model="virtio">
Nov 07 04:53:16 user nova-compute[74540]:       <stats period="10"/>
Nov 07 04:53:16 user nova-compute[74540]:     </memballoon>
Nov 07 04:53:16 user nova-compute[74540]:   </devices>
Nov 07 04:53:16 user nova-compute[74540]: </domain>
Nov 07 04:53:16 user nova-compute[74540]:  {{(pid=74540) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1761490995',display_name='tempest-TestVolumeBootPattern-server-1761490995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1761490995',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuqDm761bJfXLRS8w9ppuVTOLmnEkKBKh0Cj4XQjKHqISsPNMn8opt/7jJ76Q+ZHbqAghG3Cb0Kbj8tizrc8moE39Cktw72rga32aL/ugk/2Lf7uUi2pbur/e2P21H2Rw==',key_name='tempest-TestVolumeBootPattern-1167839782',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-kjwnxo4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-07T04:52:52Z,user_data=None,user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=a84cf003-a629-40ad-b9e4-055722fa1097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=de680766-1f0f-459b-8dc3-6e5771ee8102,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde680766-1f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG os_vif [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=de680766-1f0f-459b-8dc3-6e5771ee8102,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde680766-1f') {{(pid=74540) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46d9ddd0-b6e8-53d1-99f0-ef9c82c2c4c8', '_type': 'linux-noop'}}, row=False) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde680766-1f, may_exist=True, interface_attrs={}) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde680766-1f, col_values=(('qos', UUID('df858e59-26c3-4868-b6cd-fe8dab9df23b')),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde680766-1f, col_values=(('external_ids', {'iface-id': 'de680766-1f0f-459b-8dc3-6e5771ee8102', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:7d:17', 'vm-uuid': 'a84cf003-a629-40ad-b9e4-055722fa1097'}),), if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:16 user nova-compute[74540]: INFO os_vif [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=de680766-1f0f-459b-8dc3-6e5771ee8102,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde680766-1f')
Nov 07 04:53:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] No BDM found with device name vda, not building metadata. {{(pid=74540) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] No VIF found with MAC fa:16:3e:b7:7d:17, not building metadata {{(pid=74540) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 07 04:53:16 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-37ffd851-8cfc-49d3-a3ae-d8310bab3e51 req-ebd24bf6-2706-4371-b18e-afc434561c00 service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:53:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-37ffd851-8cfc-49d3-a3ae-d8310bab3e51 req-ebd24bf6-2706-4371-b18e-afc434561c00 service nova] Acquiring lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:53:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-37ffd851-8cfc-49d3-a3ae-d8310bab3e51 req-ebd24bf6-2706-4371-b18e-afc434561c00 service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:53:17 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-37ffd851-8cfc-49d3-a3ae-d8310bab3e51 req-ebd24bf6-2706-4371-b18e-afc434561c00 service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:53:17 user nova-compute[74540]: DEBUG nova.compute.manager [req-37ffd851-8cfc-49d3-a3ae-d8310bab3e51 req-ebd24bf6-2706-4371-b18e-afc434561c00 service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] No waiting events found dispatching network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:53:17 user nova-compute[74540]: WARNING nova.compute.manager [req-37ffd851-8cfc-49d3-a3ae-d8310bab3e51 req-ebd24bf6-2706-4371-b18e-afc434561c00 service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received unexpected event network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 for instance with vm_state building and task_state spawning.
Nov 07 04:53:17 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Instance event wait completed in 0 seconds for  {{(pid=74540) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Guest created on hypervisor {{(pid=74540) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 07 04:53:19 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Instance spawned successfully.
Nov 07 04:53:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Found default for hw_cdrom_bus of ide {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Found default for hw_disk_bus of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Found default for hw_input_bus of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Found default for hw_pointer_model of None {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Found default for hw_video_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Found default for hw_vif_model of virtio {{(pid=74540) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 07 04:53:19 user nova-compute[74540]: INFO nova.compute.manager [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 07 04:53:19 user nova-compute[74540]: DEBUG nova.compute.manager [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Checking state {{(pid=74540) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 07 04:53:19 user nova-compute[74540]: INFO nova.compute.manager [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Took 27.75 seconds to build instance.
Nov 07 04:53:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-f7112ec1-a6ca-4aac-86c5-299c11ff0f24 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "a84cf003-a629-40ad-b9e4-055722fa1097" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.855s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-6b914175-4d74-4e0e-82a7-c70a08485673 req-96f6c1c7-2928-4d6d-9137-328fedf2643e service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6b914175-4d74-4e0e-82a7-c70a08485673 req-96f6c1c7-2928-4d6d-9137-328fedf2643e service nova] Acquiring lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6b914175-4d74-4e0e-82a7-c70a08485673 req-96f6c1c7-2928-4d6d-9137-328fedf2643e service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-6b914175-4d74-4e0e-82a7-c70a08485673 req-96f6c1c7-2928-4d6d-9137-328fedf2643e service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG nova.compute.manager [req-6b914175-4d74-4e0e-82a7-c70a08485673 req-96f6c1c7-2928-4d6d-9137-328fedf2643e service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] No waiting events found dispatching network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:53:19 user nova-compute[74540]: WARNING nova.compute.manager [req-6b914175-4d74-4e0e-82a7-c70a08485673 req-96f6c1c7-2928-4d6d-9137-328fedf2643e service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received unexpected event network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 for instance with vm_state active and task_state None.
Nov 07 04:53:19 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:19 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:21 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:21 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:21 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:53:22 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74540) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 07 04:53:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:53:31 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid cd17af04-e036-495f-aeb5-c7c6e5592b06 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:53:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updating instance_info_cache with network_info: [{"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:53:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:53:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:53:35 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:53:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:53:35 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:53:35 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:53:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:53:35 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:36 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:53:36 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=24.811885833740234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cd17af04-e036-495f-aeb5-c7c6e5592b06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a84cf003-a629-40ad-b9e4-055722fa1097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing inventories for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating ProviderTree inventory for provider 6fab23dc-967a-41e4-85df-347deed7f4ba from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Updating inventory in ProviderTree for provider 6fab23dc-967a-41e4-85df-347deed7f4ba with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing aggregate associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, aggregates: None {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Refreshing trait associations for resource provider 6fab23dc-967a-41e4-85df-347deed7f4ba, traits: COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74540) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Cleaning up deleted instances {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 07 04:53:36 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] There are 0 instances to clean {{(pid=74540) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 07 04:53:37 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:46 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:51 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:53:56 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:54:01 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:04 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:54:04 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid cd17af04-e036-495f-aeb5-c7c6e5592b06 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:54:04 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Triggering sync for uuid a84cf003-a629-40ad-b9e4-055722fa1097 {{(pid=74540) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 07 04:54:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "cd17af04-e036-495f-aeb5-c7c6e5592b06" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "a84cf003-a629-40ad-b9e4-055722fa1097" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "a84cf003-a629-40ad-b9e4-055722fa1097" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:04 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "a84cf003-a629-40ad-b9e4-055722fa1097" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:54:11 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:15 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:54:16 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:54:16 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:54:19 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:54:21 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:21 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:54:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:54:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:54:22 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:54:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:54:26 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:31 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:32 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:54:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:54:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:54:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:54:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:54:33 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Updating instance_info_cache with network_info: [{"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:54:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:54:33 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:54:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:54:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:54:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:54:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:54:36 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:37 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:54:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:37 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:37 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:54:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:54:37 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:54:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:54:38 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:54:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=24.811248779296875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:54:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cd17af04-e036-495f-aeb5-c7c6e5592b06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:54:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance a84cf003-a629-40ad-b9e4-055722fa1097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:54:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:54:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:54:38 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:54:38 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:54:38 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:54:38 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:41 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:54:42 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-00612a18-4e81-417e-a6b9-593174bb9f4e req-c28e739e-a9d3-4e0e-a737-d35c97453fda service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-changed-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:54:43 user nova-compute[74540]: DEBUG nova.compute.manager [req-00612a18-4e81-417e-a6b9-593174bb9f4e req-c28e739e-a9d3-4e0e-a737-d35c97453fda service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Refreshing instance network info cache due to event network-changed-de680766-1f0f-459b-8dc3-6e5771ee8102. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:54:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-00612a18-4e81-417e-a6b9-593174bb9f4e req-c28e739e-a9d3-4e0e-a737-d35c97453fda service nova] Acquiring lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:54:43 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-00612a18-4e81-417e-a6b9-593174bb9f4e req-c28e739e-a9d3-4e0e-a737-d35c97453fda service nova] Acquired lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:54:43 user nova-compute[74540]: DEBUG nova.network.neutron [req-00612a18-4e81-417e-a6b9-593174bb9f4e req-c28e739e-a9d3-4e0e-a737-d35c97453fda service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Refreshing network info cache for port de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG nova.network.neutron [req-00612a18-4e81-417e-a6b9-593174bb9f4e req-c28e739e-a9d3-4e0e-a737-d35c97453fda service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Updated VIF entry in instance network info cache for port de680766-1f0f-459b-8dc3-6e5771ee8102. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG nova.network.neutron [req-00612a18-4e81-417e-a6b9-593174bb9f4e req-c28e739e-a9d3-4e0e-a737-d35c97453fda service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Updating instance_info_cache with network_info: [{"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-00612a18-4e81-417e-a6b9-593174bb9f4e req-c28e739e-a9d3-4e0e-a737-d35c97453fda service nova] Releasing lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-48e06e7a-84cb-47ed-b822-bbc30090a2ba req-868c06e0-00ff-4885-afbb-7cbe7b7cb135 service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-changed-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG nova.compute.manager [req-48e06e7a-84cb-47ed-b822-bbc30090a2ba req-868c06e0-00ff-4885-afbb-7cbe7b7cb135 service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Refreshing instance network info cache due to event network-changed-de680766-1f0f-459b-8dc3-6e5771ee8102. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-48e06e7a-84cb-47ed-b822-bbc30090a2ba req-868c06e0-00ff-4885-afbb-7cbe7b7cb135 service nova] Acquiring lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-48e06e7a-84cb-47ed-b822-bbc30090a2ba req-868c06e0-00ff-4885-afbb-7cbe7b7cb135 service nova] Acquired lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG nova.network.neutron [req-48e06e7a-84cb-47ed-b822-bbc30090a2ba req-868c06e0-00ff-4885-afbb-7cbe7b7cb135 service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Refreshing network info cache for port de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "a84cf003-a629-40ad-b9e4-055722fa1097" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "a84cf003-a629-40ad-b9e4-055722fa1097" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:44 user nova-compute[74540]: INFO nova.compute.manager [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Terminating instance
Nov 07 04:54:44 user nova-compute[74540]: DEBUG nova.compute.manager [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG nova.network.neutron [req-48e06e7a-84cb-47ed-b822-bbc30090a2ba req-868c06e0-00ff-4885-afbb-7cbe7b7cb135 service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Updated VIF entry in instance network info cache for port de680766-1f0f-459b-8dc3-6e5771ee8102. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG nova.network.neutron [req-48e06e7a-84cb-47ed-b822-bbc30090a2ba req-868c06e0-00ff-4885-afbb-7cbe7b7cb135 service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Updating instance_info_cache with network_info: [{"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:54:44 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-48e06e7a-84cb-47ed-b822-bbc30090a2ba req-868c06e0-00ff-4885-afbb-7cbe7b7cb135 service nova] Releasing lock "refresh_cache-a84cf003-a629-40ad-b9e4-055722fa1097" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:45 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Instance destroyed successfully.
Nov 07 04:54:45 user nova-compute[74540]: DEBUG nova.objects.instance [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lazy-loading 'resources' on Instance uuid a84cf003-a629-40ad-b9e4-055722fa1097 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1761490995',display_name='tempest-TestVolumeBootPattern-server-1761490995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1761490995',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuqDm761bJfXLRS8w9ppuVTOLmnEkKBKh0Cj4XQjKHqISsPNMn8opt/7jJ76Q+ZHbqAghG3Cb0Kbj8tizrc8moE39Cktw72rga32aL/ugk/2Lf7uUi2pbur/e2P21H2Rw==',key_name='tempest-TestVolumeBootPattern-1167839782',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:53:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-kjwnxo4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:53:20Z,user_data=None,user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=a84cf003-a629-40ad-b9e4-055722fa1097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "de680766-1f0f-459b-8dc3-6e5771ee8102", "address": "fa:16:3e:b7:7d:17", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde680766-1f", "ovs_interfaceid": "de680766-1f0f-459b-8dc3-6e5771ee8102", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=de680766-1f0f-459b-8dc3-6e5771ee8102,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde680766-1f') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_vif [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=de680766-1f0f-459b-8dc3-6e5771ee8102,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde680766-1f') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde680766-1f, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df858e59-26c3-4868-b6cd-fe8dab9df23b) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:54:45 user nova-compute[74540]: INFO os_vif [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:7d:17,bridge_name='br-int',has_traffic_filtering=True,id=de680766-1f0f-459b-8dc3-6e5771ee8102,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde680766-1f')
Nov 07 04:54:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZnWCOUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:54:45 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[534e8c72-030c-470b-8eed-9363cb507c25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:54:45 user nova-compute[74540]: No targets found.
Nov 07 04:54:45 user nova-compute[74540]: iSNS:
Nov 07 04:54:45 user nova-compute[74540]: No targets found.
Nov 07 04:54:45 user nova-compute[74540]: STATIC:
Nov 07 04:54:45 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7
Nov 07 04:54:45 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:54:45 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:54:45 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced
Nov 07 04:54:45 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:54:45 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:54:45 user nova-compute[74540]: FIRMWARE:
Nov 07 04:54:45 user nova-compute[74540]: No targets found.
Nov 07 04:54:45 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:54:45 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:54:45 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b7bf52-f18b-41e2-a58f-062c775a3e03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2bded3-8b1f-40b4-a6a1-8d7ccff3c227]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:54:45 user nova-compute[74540]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced (non-flash)
Nov 07 04:54:45 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:54:45 user nova-compute[74540]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced (non-flash)
Nov 07 04:54:45 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fedfc765ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced'): ({'sdc'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Removing single pathed devices sdc {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0fc7ef-4974-480c-a25d-2624036e3d93]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26f31dc-36a3-46e3-85a2-477c167e2b31]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flushing IO for device /dev/sdc {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1799d9fc-b7e9-4811-a1ac-dc0483899128]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[850bffc0-32f1-45c9-9d23-764ecb8ec19f]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] SCSI volumes sdc have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be11af0-f98e-4172-ad68-a84ffd535e44]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fc6ac6-1cb5-45e3-b7c0-7eaff5cbd624]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced, portal: 172.16.0.220,3260]
Nov 07 04:54:45 user nova-compute[74540]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced, portal: 172.16.0.220,3260] successful.
Nov 07 04:54:45 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b2fb1b7-4a32-4b18-8d6f-196568641ced -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70f66f5-7589-4d06-84f5-aebdb880bab7]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== disconnect_volume: return (308ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:54:45 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Deleting instance files /opt/stack/data/nova/instances/a84cf003-a629-40ad-b9e4-055722fa1097_del
Nov 07 04:54:45 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Deletion of /opt/stack/data/nova/instances/a84cf003-a629-40ad-b9e4-055722fa1097_del complete
Nov 07 04:54:45 user nova-compute[74540]: INFO nova.compute.manager [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 07 04:54:45 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:54:46 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Took 0.63 seconds to deallocate network for instance.
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-678d76da-df70-4717-872b-ad588653ac42 req-cf420698-e54d-48f1-992d-fa6778723042 service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-vif-deleted-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-vif-unplugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Acquiring lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] No waiting events found dispatching network-vif-unplugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-vif-unplugged-de680766-1f0f-459b-8dc3-6e5771ee8102 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Acquiring lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] No waiting events found dispatching network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:54:46 user nova-compute[74540]: WARNING nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received unexpected event network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 for instance with vm_state active and task_state deleting.
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Acquiring lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] No waiting events found dispatching network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:54:46 user nova-compute[74540]: WARNING nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received unexpected event network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 for instance with vm_state active and task_state deleting.
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Acquiring lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] No waiting events found dispatching network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:54:46 user nova-compute[74540]: WARNING nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received unexpected event network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 for instance with vm_state active and task_state deleting.
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-vif-unplugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Acquiring lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] No waiting events found dispatching network-vif-unplugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-vif-unplugged-de680766-1f0f-459b-8dc3-6e5771ee8102 for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received event network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Acquiring lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] Lock "a84cf003-a629-40ad-b9e4-055722fa1097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:46 user nova-compute[74540]: DEBUG nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] No waiting events found dispatching network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:54:46 user nova-compute[74540]: WARNING nova.compute.manager [req-1c1a37c6-ab73-4eb6-8357-cb3f0e57f513 req-865ba13e-f62a-4b13-b5a3-2f07ede7a49a service nova] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Received unexpected event network-vif-plugged-de680766-1f0f-459b-8dc3-6e5771ee8102 for instance with vm_state active and task_state deleting.
Nov 07 04:54:47 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:47 user nova-compute[74540]: INFO nova.compute.manager [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: a84cf003-a629-40ad-b9e4-055722fa1097] Took 0.96 seconds to detach 1 volumes for instance.
Nov 07 04:54:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:54:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:54:47 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:54:47 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:54:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:47 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Deleted allocations for instance a84cf003-a629-40ad-b9e4-055722fa1097
Nov 07 04:54:47 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-7b5e975a-aeea-459a-b5e4-911c68302da9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "a84cf003-a629-40ad-b9e4-055722fa1097" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.257s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:54:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:54:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:54:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:54:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:54:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:54:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:54:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:55:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:05 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:55:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:10 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:55:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:15 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:16 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:55:18 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:55:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:55:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:20 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:20 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:55:21 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:55:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:55:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:55:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:55:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:55:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:55:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:25 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:25 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:55:30 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:32 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:55:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:55:32 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:55:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:55:32 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquired lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:55:32 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Forcefully refreshing network info cache for instance {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 07 04:55:32 user nova-compute[74540]: DEBUG nova.objects.instance [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lazy-loading 'info_cache' on Instance uuid cd17af04-e036-495f-aeb5-c7c6e5592b06 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:55:33 user nova-compute[74540]: DEBUG nova.network.neutron [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updating instance_info_cache with network_info: [{"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:55:33 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Releasing lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:55:33 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updated the network info_cache for instance {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 07 04:55:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:55:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:35 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:55:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:55:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:55:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:55:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:55:39 user nova-compute[74540]: DEBUG nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74540) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 07 04:55:40 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:55:40 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:55:40 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=24.810199737548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:55:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:55:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:55:40 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:40 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Instance cd17af04-e036-495f-aeb5-c7c6e5592b06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74540) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 07 04:55:40 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:55:40 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:55:40 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:55:40 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:55:40 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:55:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:55:45 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:55:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:55:50 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:55 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:57 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-40d639bd-b8de-4fdb-9a4d-4a50bc023d6d req-c2e94cfb-ab24-47b0-a1a8-94a88d0567a9 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Received event network-changed-0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:55:57 user nova-compute[74540]: DEBUG nova.compute.manager [req-40d639bd-b8de-4fdb-9a4d-4a50bc023d6d req-c2e94cfb-ab24-47b0-a1a8-94a88d0567a9 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Refreshing instance network info cache due to event network-changed-0c0c9dbc-75b1-486c-8345-a1f20ab63efb. {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 07 04:55:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-40d639bd-b8de-4fdb-9a4d-4a50bc023d6d req-c2e94cfb-ab24-47b0-a1a8-94a88d0567a9 service nova] Acquiring lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 07 04:55:57 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-40d639bd-b8de-4fdb-9a4d-4a50bc023d6d req-c2e94cfb-ab24-47b0-a1a8-94a88d0567a9 service nova] Acquired lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 07 04:55:57 user nova-compute[74540]: DEBUG nova.network.neutron [req-40d639bd-b8de-4fdb-9a4d-4a50bc023d6d req-c2e94cfb-ab24-47b0-a1a8-94a88d0567a9 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Refreshing network info cache for port 0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "cd17af04-e036-495f-aeb5-c7c6e5592b06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:55:58 user nova-compute[74540]: INFO nova.compute.manager [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Terminating instance
Nov 07 04:55:58 user nova-compute[74540]: DEBUG nova.compute.manager [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Start destroying the instance on the hypervisor. {{(pid=74540) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG nova.network.neutron [req-40d639bd-b8de-4fdb-9a4d-4a50bc023d6d req-c2e94cfb-ab24-47b0-a1a8-94a88d0567a9 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updated VIF entry in instance network info cache for port 0c0c9dbc-75b1-486c-8345-a1f20ab63efb. {{(pid=74540) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG nova.network.neutron [req-40d639bd-b8de-4fdb-9a4d-4a50bc023d6d req-c2e94cfb-ab24-47b0-a1a8-94a88d0567a9 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updating instance_info_cache with network_info: [{"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-40d639bd-b8de-4fdb-9a4d-4a50bc023d6d req-c2e94cfb-ab24-47b0-a1a8-94a88d0567a9 service nova] Releasing lock "refresh_cache-cd17af04-e036-495f-aeb5-c7c6e5592b06" {{(pid=74540) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-4c9a35e1-bbfa-445f-a460-807bc9d4a53b req-0702684e-e5df-4322-8fdf-106c322c43cc service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Received event network-vif-unplugged-0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4c9a35e1-bbfa-445f-a460-807bc9d4a53b req-0702684e-e5df-4322-8fdf-106c322c43cc service nova] Acquiring lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4c9a35e1-bbfa-445f-a460-807bc9d4a53b req-0702684e-e5df-4322-8fdf-106c322c43cc service nova] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-4c9a35e1-bbfa-445f-a460-807bc9d4a53b req-0702684e-e5df-4322-8fdf-106c322c43cc service nova] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-4c9a35e1-bbfa-445f-a460-807bc9d4a53b req-0702684e-e5df-4322-8fdf-106c322c43cc service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] No waiting events found dispatching network-vif-unplugged-0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG nova.compute.manager [req-4c9a35e1-bbfa-445f-a460-807bc9d4a53b req-0702684e-e5df-4322-8fdf-106c322c43cc service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Received event network-vif-unplugged-0c0c9dbc-75b1-486c-8345-a1f20ab63efb for instance with task_state deleting. {{(pid=74540) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 07 04:55:58 user nova-compute[74540]: INFO nova.virt.libvirt.driver [-] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Instance destroyed successfully.
Nov 07 04:55:58 user nova-compute[74540]: DEBUG nova.objects.instance [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lazy-loading 'resources' on Instance uuid cd17af04-e036-495f-aeb5-c7c6e5592b06 {{(pid=74540) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG nova.virt.libvirt.vif [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-07T04:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1429431724',display_name='tempest-TestVolumeBootPattern-server-1429431724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1429431724',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuqDm761bJfXLRS8w9ppuVTOLmnEkKBKh0Cj4XQjKHqISsPNMn8opt/7jJ76Q+ZHbqAghG3Cb0Kbj8tizrc8moE39Cktw72rga32aL/ugk/2Lf7uUi2pbur/e2P21H2Rw==',key_name='tempest-TestVolumeBootPattern-1167839782',keypairs=<?>,launch_index=0,launched_at=2023-11-07T04:51:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b96003f4fda04df99e4c1e37a139d0f1',ramdisk_id='',reservation_id='r-60ryzdv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-621203767',owner_user_name='tempest-TestVolumeBootPattern-621203767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-07T04:51:06Z,user_data=None,user_id='23c9b2aeb83c4e2780c123bdb32b9dde',uuid=cd17af04-e036-495f-aeb5-c7c6e5592b06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converting VIF {"id": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "address": "fa:16:3e:9a:e1:35", "network": {"id": "3a743240-e55a-45f5-8270-74520de90964", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1744865415-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96003f4fda04df99e4c1e37a139d0f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0c9dbc-75", "ovs_interfaceid": "0c0c9dbc-75b1-486c-8345-a1f20ab63efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG nova.network.os_vif_util [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:e1:35,bridge_name='br-int',has_traffic_filtering=True,id=0c0c9dbc-75b1-486c-8345-a1f20ab63efb,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0c9dbc-75') {{(pid=74540) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 07 04:55:58 user nova-compute[74540]: DEBUG os_vif [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:e1:35,bridge_name='br-int',has_traffic_filtering=True,id=0c0c9dbc-75b1-486c-8345-a1f20ab63efb,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0c9dbc-75') {{(pid=74540) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c0c9dbc-75, bridge=br-int, if_exists=True) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aad9c8b-4d58-411a-b502-5e4c461edbfd) {{(pid=74540) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:55:59 user nova-compute[74540]: INFO os_vif [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:e1:35,bridge_name='br-int',has_traffic_filtering=True,id=0c0c9dbc-75b1-486c-8345-a1f20ab63efb,network=Network(3a743240-e55a-45f5-8270-74520de90964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0c9dbc-75')
Nov 07 04:55:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] calling os-brick to detach iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fedfc779150>, {'target_iqn': 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuXIYgjx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 07 04:55:59 user nova-compute[74540]: WARNING os_brick.initiator.connectors.base [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde3537a-60c8-4c3b-bb04-b1e724f80bb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 07 04:55:59 user nova-compute[74540]: No targets found.
Nov 07 04:55:59 user nova-compute[74540]: iSNS:
Nov 07 04:55:59 user nova-compute[74540]: No targets found.
Nov 07 04:55:59 user nova-compute[74540]: STATIC:
Nov 07 04:55:59 user nova-compute[74540]: Target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7
Nov 07 04:55:59 user nova-compute[74540]:         Portal: 172.16.0.220:3260,-1
Nov 07 04:55:59 user nova-compute[74540]:                 Iface Name: default
Nov 07 04:55:59 user nova-compute[74540]: FIRMWARE:
Nov 07 04:55:59 user nova-compute[74540]: No targets found.
Nov 07 04:55:59 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 07 04:55:59 user nova-compute[74540]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 07 04:55:59 user nova-compute[74540]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74540) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7', 0)] {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbfd792-515d-4891-8ed5-fa41d0675c30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fefdb39-cf89-42ac-9c21-4d5cad757cab]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:55:59 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 (non-flash)
Nov 07 04:55:59 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fee1d52af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7'): ({'sdb'}, set())}) {{(pid=74540) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Removing single pathed devices sdb {{(pid=74540) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c86d09-effe-4317-8765-6d602a506417]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3934220e-270f-4967-8cb1-2c7db9563e81]: (4, ('ok\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Flushing IO for device /dev/sdb {{(pid=74540) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f452ff-2193-4a47-a31e-a204d08f35be]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74540) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaed466-be21-499d-88ab-a5e6b4116ec7]: (4, ('1', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.linuxscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] SCSI volumes sdb have been removed. {{(pid=74540) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7')] {{(pid=74540) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82c3b8b-5d0c-4bc3-b0d8-0bfac4e8589c]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --logout {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c730d9-a877-4d19-b5eb-d60a3ecd0bc0]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260]
Nov 07 04:55:59 user nova-compute[74540]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7, portal: 172.16.0.220,3260] successful.
Nov 07 04:55:59 user nova-compute[74540]:  stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op delete {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec05e51-a9ae-441e-b3dc-d4b76212a2c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85868) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdc9d47-2228-4407-b0c9-aa6ed56dd8f8]: (4, ('', '')) {{(pid=85868) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74540) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.base [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] <== disconnect_volume: return (276ms) None {{(pid=74540) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Disconnected iSCSI Volume {{(pid=74540) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 07 04:55:59 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Deleting instance files /opt/stack/data/nova/instances/cd17af04-e036-495f-aeb5-c7c6e5592b06_del
Nov 07 04:55:59 user nova-compute[74540]: INFO nova.virt.libvirt.driver [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Deletion of /opt/stack/data/nova/instances/cd17af04-e036-495f-aeb5-c7c6e5592b06_del complete
Nov 07 04:55:59 user nova-compute[74540]: INFO nova.compute.manager [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 07 04:55:59 user nova-compute[74540]: DEBUG oslo.service.loopingcall [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74540) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG nova.compute.manager [-] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Deallocating network for instance {{(pid=74540) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] deallocate_for_instance() {{(pid=74540) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 07 04:55:59 user nova-compute[74540]: DEBUG nova.network.neutron [-] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Updating instance_info_cache with network_info: [] {{(pid=74540) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 07 04:55:59 user nova-compute[74540]: INFO nova.compute.manager [-] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Took 0.42 seconds to deallocate network for instance.
Nov 07 04:56:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-3c30d997-3869-4797-93f9-24ffbbc92081 req-b9aefebc-a406-460a-9de8-826cfbd34122 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Received event network-vif-deleted-0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:56:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-f531aa79-010d-4157-8a98-8e29e6401c2c req-d74aedfe-36c6-4185-8060-abfa89d574c5 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Received event network-vif-plugged-0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 07 04:56:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f531aa79-010d-4157-8a98-8e29e6401c2c req-d74aedfe-36c6-4185-8060-abfa89d574c5 service nova] Acquiring lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:56:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f531aa79-010d-4157-8a98-8e29e6401c2c req-d74aedfe-36c6-4185-8060-abfa89d574c5 service nova] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:56:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [req-f531aa79-010d-4157-8a98-8e29e6401c2c req-d74aedfe-36c6-4185-8060-abfa89d574c5 service nova] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:56:00 user nova-compute[74540]: DEBUG nova.compute.manager [req-f531aa79-010d-4157-8a98-8e29e6401c2c req-d74aedfe-36c6-4185-8060-abfa89d574c5 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] No waiting events found dispatching network-vif-plugged-0c0c9dbc-75b1-486c-8345-a1f20ab63efb {{(pid=74540) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 07 04:56:00 user nova-compute[74540]: WARNING nova.compute.manager [req-f531aa79-010d-4157-8a98-8e29e6401c2c req-d74aedfe-36c6-4185-8060-abfa89d574c5 service nova] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Received unexpected event network-vif-plugged-0c0c9dbc-75b1-486c-8345-a1f20ab63efb for instance with vm_state active and task_state deleting.
Nov 07 04:56:00 user nova-compute[74540]: INFO nova.compute.manager [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] [instance: cd17af04-e036-495f-aeb5-c7c6e5592b06] Took 1.04 seconds to detach 1 volumes for instance.
Nov 07 04:56:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:56:00 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:56:00 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:56:00 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:56:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.102s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:56:01 user nova-compute[74540]: INFO nova.scheduler.client.report [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Deleted allocations for instance cd17af04-e036-495f-aeb5-c7c6e5592b06
Nov 07 04:56:01 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-78a170cb-bb37-4032-80f2-0274dc5209f9 tempest-TestVolumeBootPattern-621203767 tempest-TestVolumeBootPattern-621203767-project-member] Lock "cd17af04-e036-495f-aeb5-c7c6e5592b06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.899s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:56:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:56:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:56:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:56:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:56:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:56:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:56:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:56:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:56:16 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:56:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:56:20 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:56:21 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:56:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:56:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:56:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:56:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:56:24 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:56:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:56:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:56:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:56:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:56:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:56:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:56:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:56:34 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:56:34 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:56:34 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Starting heal instance info cache {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 07 04:56:34 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Rebuilding the list of instances to heal {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 07 04:56:34 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Didn't find any instances for network info cache update. {{(pid=74540) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 07 04:56:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:56:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:56:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:56:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:56:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:56:39 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:56:39 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:56:39 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:56:39 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Auditing locally available compute resources for user (node: user) {{(pid=74540) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 07 04:56:40 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:56:40 user nova-compute[74540]: WARNING nova.virt.libvirt.driver [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 07 04:56:40 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Hypervisor/Node resource view: name=user free_ram=9100MB free_disk=24.809322357177734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74540) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 07 04:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 07 04:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 07 04:56:40 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 07 04:56:40 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74540) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 07 04:56:40 user nova-compute[74540]: DEBUG nova.compute.provider_tree [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed in ProviderTree for provider: 6fab23dc-967a-41e4-85df-347deed7f4ba {{(pid=74540) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 07 04:56:40 user nova-compute[74540]: DEBUG nova.scheduler.client.report [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Inventory has not changed for provider 6fab23dc-967a-41e4-85df-347deed7f4ba based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74540) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 07 04:56:40 user nova-compute[74540]: DEBUG nova.compute.resource_tracker [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Compute_service record updated for user:user {{(pid=74540) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 07 04:56:40 user nova-compute[74540]: DEBUG oslo_concurrency.lockutils [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=74540) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 07 04:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:56:44 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:56:49 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:56:54 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:56:59 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:57:00 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:57:03 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:57:04 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:57:06 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:57:09 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:57:14 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:57:17 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:57:19 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:57:21 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:57:22 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:57:23 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:57:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 07 04:57:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:57:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74540) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 07 04:57:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:57:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74540) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 07 04:57:24 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 07 04:57:24 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:57:25 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:57:26 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:57:26 user nova-compute[74540]: DEBUG nova.compute.manager [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74540) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 07 04:57:27 user nova-compute[74540]: DEBUG oslo_service.periodic_task [None req-e99ff116-a026-48f5-9119-1fe85e576533 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74540) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 07 04:57:29 user nova-compute[74540]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74540) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}